Jun 16 19:46:35.491054 ip-10-0-138-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 16 19:46:35.491066 ip-10-0-138-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 16 19:46:35.491077 ip-10-0-138-253 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 16 19:46:35.491546 ip-10-0-138-253 systemd[1]: Failed to start Kubernetes Kubelet. Jun 16 19:46:44.544763 ip-10-0-138-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 16 19:46:44.544777 ip-10-0-138-253 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 70589a3497bd464dbcbdffa19ec6ef2a -- Jun 16 19:48:36.467777 ip-10-0-138-253 systemd[1]: Starting Kubernetes Kubelet... Jun 16 19:48:36.926096 ip-10-0-138-253 kubenswrapper[2550]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:48:36.926096 ip-10-0-138-253 kubenswrapper[2550]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 16 19:48:36.926096 ip-10-0-138-253 kubenswrapper[2550]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:48:36.926096 ip-10-0-138-253 kubenswrapper[2550]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 16 19:48:36.926096 ip-10-0-138-253 kubenswrapper[2550]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:48:36.928134 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.928042 2550 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 16 19:48:36.933135 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933119 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.933135 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933135 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933139 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933143 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933146 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933149 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933153 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933156 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933159 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933162 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933164 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933167 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933169 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933172 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933174 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933177 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933180 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933183 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933193 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933196 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.933216 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933201 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933204 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933207 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933210 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933213 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933216 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933218 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933221 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933224 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933227 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933232 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933235 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933238 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933241 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933244 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933247 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933250 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933253 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933256 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.933712 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933259 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933261 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933264 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933266 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933269 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933272 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933276 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933278 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933280 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933283 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933285 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933288 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933290 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933293 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933295 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933299 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933302 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933304 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933307 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933310 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.934161 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933313 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933315 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933318 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933320 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933323 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933325 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933328 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933330 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933333 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933335 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933338 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933341 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933344 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933346 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933349 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933351 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933354 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933356 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933359 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933361 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.934674 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933364 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933366 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933369 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933371 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933374 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933376 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933379 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933382 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933385 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933387 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933390 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933394 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933398 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933401 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933403 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933407 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933410 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933413 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933415 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.935146 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.933418 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934119 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934127 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934132 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934135 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934138 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934142 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934145 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934148 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934151 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934154 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934157 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934159 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934162 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934165 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934168 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934171 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934174 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934177 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.935643 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934180 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934183 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934186 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934189 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934191 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934194 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934197 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934200 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934202 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934205 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934208 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934210 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934213 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934215 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934218 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934220 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934222 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934225 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934228 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934230 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.936147 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934240 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934243 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934245 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934248 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934250 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934253 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934256 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934258 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934260 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934264 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934266 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934271 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934273 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934276 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934279 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934282 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934285 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934288 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934290 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934293 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.936645 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934295 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934298 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934301 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934303 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934306 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934309 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934311 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934314 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934317 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934319 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934322 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934324 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934327 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934330 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934333 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934335 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934339 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934342 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934345 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934347 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.937130 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934350 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934353 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934355 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934360 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934364 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934367 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934371 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934373 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934376 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934379 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934381 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934384 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934387 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934390 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934392 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934395 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934397 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934400 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934402 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.937618 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934405 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934407 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934796 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934802 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934805 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934808 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934811 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934814 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934817 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934819 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934823 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934825 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934828 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934831 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934834 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934837 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934839 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934842 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934845 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934848 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.938068 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934850 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934853 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934855 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934858 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934861 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934863 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934866 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934868 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934871 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934873 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934876 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934878 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934883 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934886 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934889 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934892 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934895 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934898 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934901 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934904 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.938582 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934907 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934910 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934913 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934916 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934918 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934922 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934925 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934928 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934931 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934933 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934936 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934939 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934941 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934944 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934946 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934949 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934952 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934955 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934957 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934960 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.939101 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934962 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934964 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934967 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934970 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934972 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934975 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934977 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934980 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934983 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934985 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934988 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934991 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934994 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.934996 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935002 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935005 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935008 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935010 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935013 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.939695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935016 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935019 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935021 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935026 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935029 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935032 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935035 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935039 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935041 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935044 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935047 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935049 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935052 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935055 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935057 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935060 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935062 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935066 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935070 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.940150 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935073 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935076 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935078 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935151 2550 flags.go:64] FLAG: --address="0.0.0.0" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935158 2550 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935164 2550 flags.go:64] FLAG: --anonymous-auth="true" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935168 2550 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935173 2550 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935178 2550 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935182 2550 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935187 2550 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935190 2550 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935194 2550 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935197 2550 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935200 2550 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935203 2550 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935208 2550 flags.go:64] FLAG: --cgroup-root="" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935210 2550 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935213 2550 flags.go:64] FLAG: --client-ca-file="" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935216 2550 flags.go:64] FLAG: --cloud-provider="external" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935219 2550 flags.go:64] FLAG: --cluster-dns="[]" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935224 2550 flags.go:64] FLAG: --cluster-domain="" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935227 2550 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 16 19:48:36.940617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935230 2550 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935233 2550 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935237 2550 flags.go:64] FLAG: --container-log-max-files="5" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935241 2550 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935244 2550 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935247 2550 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935251 2550 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935254 2550 flags.go:64] FLAG: --contention-profiling="false" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935257 2550 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935260 2550 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935263 2550 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935267 2550 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935271 2550 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935274 2550 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935277 2550 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935280 2550 flags.go:64] FLAG: --enable-load-reader="false" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935283 2550 flags.go:64] FLAG: --enable-server="true" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935290 2550 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935294 2550 flags.go:64] FLAG: --event-burst="100" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935297 2550 flags.go:64] FLAG: --event-qps="50" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935301 2550 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935304 2550 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935306 2550 flags.go:64] FLAG: --eviction-hard="" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935310 2550 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 16 19:48:36.941176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935314 2550 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935318 2550 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935321 2550 flags.go:64] FLAG: --eviction-soft="" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935324 2550 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935327 2550 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935330 2550 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935333 2550 flags.go:64] FLAG: --experimental-mounter-path="" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935336 2550 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935339 2550 flags.go:64] FLAG: --fail-swap-on="true" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935342 2550 flags.go:64] FLAG: --feature-gates="" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935346 2550 flags.go:64] FLAG: --file-check-frequency="20s" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935349 2550 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935352 2550 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935355 2550 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935358 2550 flags.go:64] FLAG: --healthz-port="10248" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935361 2550 flags.go:64] FLAG: --help="false" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935364 2550 flags.go:64] FLAG: --hostname-override="ip-10-0-138-253.ec2.internal" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935367 2550 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935370 2550 flags.go:64] FLAG: --http-check-frequency="20s" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935373 2550 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935376 2550 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935380 2550 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935383 2550 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 16 19:48:36.941749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935386 2550 flags.go:64] FLAG: --image-service-endpoint="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935389 2550 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935393 2550 flags.go:64] FLAG: --kube-api-burst="100" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935397 2550 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935401 2550 flags.go:64] FLAG: --kube-api-qps="50" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935403 2550 flags.go:64] FLAG: --kube-reserved="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935406 2550 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935409 2550 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935412 2550 flags.go:64] FLAG: --kubelet-cgroups="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935415 2550 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935420 2550 flags.go:64] FLAG: --lock-file="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935422 2550 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935425 2550 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935428 2550 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935433 2550 flags.go:64] FLAG: --log-json-split-stream="false" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935436 2550 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935439 2550 flags.go:64] FLAG: --log-text-split-stream="false" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935442 2550 flags.go:64] FLAG: --logging-format="text" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935445 2550 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935448 2550 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935451 2550 flags.go:64] FLAG: --manifest-url="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935454 2550 flags.go:64] FLAG: --manifest-url-header="" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935488 2550 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935492 2550 flags.go:64] FLAG: --max-open-files="1000000" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935502 2550 flags.go:64] FLAG: --max-pods="110" Jun 16 19:48:36.942319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935506 2550 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935509 2550 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935512 2550 flags.go:64] FLAG: --memory-manager-policy="None" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935515 2550 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935518 2550 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935521 2550 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935524 2550 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935531 2550 flags.go:64] FLAG: --node-status-max-images="50" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935534 2550 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935538 2550 flags.go:64] FLAG: --oom-score-adj="-999" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935541 2550 flags.go:64] FLAG: --pod-cidr="" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935545 2550 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935550 2550 flags.go:64] FLAG: --pod-manifest-path="" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935554 2550 flags.go:64] FLAG: --pod-max-pids="-1" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935557 2550 flags.go:64] FLAG: --pods-per-core="0" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935560 2550 flags.go:64] FLAG: --port="10250" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935563 2550 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935567 2550 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08641af1361642302" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935570 2550 flags.go:64] FLAG: --qos-reserved="" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935573 2550 flags.go:64] FLAG: --read-only-port="10255" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935576 2550 flags.go:64] FLAG: --register-node="true" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935579 2550 flags.go:64] FLAG: --register-with-taints="" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935583 2550 flags.go:64] FLAG: --registry-burst="10" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935585 2550 flags.go:64] FLAG: --registry-qps="5" Jun 16 19:48:36.942998 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935588 2550 flags.go:64] FLAG: --reserved-cpus="" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935591 2550 flags.go:64] FLAG: --reserved-memory="" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935595 2550 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935598 2550 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935601 2550 flags.go:64] FLAG: --rotate-certificates="false" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935604 2550 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935607 2550 flags.go:64] FLAG: --runonce="false" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935610 2550 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935613 2550 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935616 2550 flags.go:64] FLAG: --seccomp-default="false" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935619 2550 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935622 2550 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935625 2550 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935628 2550 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935631 2550 flags.go:64] FLAG: --storage-driver-password="root" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935634 2550 flags.go:64] FLAG: --storage-driver-secure="false" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935638 2550 flags.go:64] FLAG: --storage-driver-table="stats" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935641 2550 flags.go:64] FLAG: --storage-driver-user="root" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935645 2550 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935648 2550 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935651 2550 flags.go:64] FLAG: --system-cgroups="" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935655 2550 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935660 2550 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935663 2550 flags.go:64] FLAG: --tls-cert-file="" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935666 2550 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 16 19:48:36.943591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935672 2550 flags.go:64] FLAG: --tls-min-version="" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935675 2550 flags.go:64] FLAG: --tls-private-key-file="" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935678 2550 flags.go:64] FLAG: --topology-manager-policy="none" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935681 2550 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935684 2550 flags.go:64] FLAG: --topology-manager-scope="container" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935687 2550 flags.go:64] FLAG: --v="2" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935691 2550 flags.go:64] FLAG: --version="false" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935695 2550 flags.go:64] FLAG: --vmodule="" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935699 2550 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.935702 2550 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935818 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935822 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935825 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935828 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935831 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935835 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935838 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935840 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935843 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935846 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935849 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935851 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.944191 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935854 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935857 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935860 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935863 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935866 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935868 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935871 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935874 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935878 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935882 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935887 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935889 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935892 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935895 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935897 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935900 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935902 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935905 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935907 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935910 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.944929 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935913 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935915 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935918 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935920 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935923 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935925 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935928 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935930 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935933 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935936 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935938 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935941 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935943 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935946 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935949 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935951 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935955 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935958 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935962 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.945809 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935965 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935968 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935971 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935975 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935978 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935981 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.935997 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936001 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936004 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936007 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936010 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936013 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936015 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936018 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936021 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936024 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936027 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936029 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936032 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936034 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.946628 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936037 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936040 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936042 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936045 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936047 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936050 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936052 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936055 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936057 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936061 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936064 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936067 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936070 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936073 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936076 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936080 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936083 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936085 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936088 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936090 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.947237 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936093 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936095 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936098 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936100 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936103 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936105 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936108 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.936111 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.936888 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.946832 2550 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 16 19:48:36.947808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.946851 2550 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.947855 2550 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.947871 2550 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947957 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947965 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947969 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947975 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947979 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947984 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947988 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947993 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.947997 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948001 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948008 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948014 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948019 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948024 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948028 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948032 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.948228 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948036 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948041 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948045 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948049 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948053 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948058 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948062 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948067 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948071 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948075 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948079 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948084 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948088 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948093 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948097 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948102 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948107 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948114 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948120 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.949008 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948125 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948129 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948134 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948138 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948142 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948146 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948150 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948155 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948159 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948163 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948167 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948172 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948176 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948180 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948184 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948188 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948192 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948197 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948201 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948205 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.949781 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948209 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948213 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948218 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948222 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948226 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948230 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948235 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948240 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948244 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948248 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948252 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948257 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948261 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948265 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948270 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948274 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948278 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948282 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948286 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948290 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.950610 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948295 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948299 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948303 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948307 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948311 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948316 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948321 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948325 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948329 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948334 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948338 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948342 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948346 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948350 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948355 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948359 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948365 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948370 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948375 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.951098 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948380 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948386 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948391 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948395 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.948400 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.948408 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949485 2550 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949501 2550 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949507 2550 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949512 2550 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949517 2550 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949525 2550 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949539 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949544 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:48:36.951577 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949549 2550 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949554 2550 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949560 2550 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949564 2550 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949569 2550 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949573 2550 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949578 2550 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949583 2550 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949587 2550 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949592 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949602 2550 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949606 2550 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949611 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949616 2550 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949620 2550 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949624 2550 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949629 2550 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949634 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949639 2550 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949644 2550 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:48:36.951921 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949659 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949664 2550 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949673 2550 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949678 2550 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949683 2550 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949687 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949691 2550 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949696 2550 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949700 2550 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949705 2550 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949710 2550 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949715 2550 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949719 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949724 2550 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949728 2550 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949737 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949742 2550 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949746 2550 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949751 2550 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:48:36.952404 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949756 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949760 2550 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949765 2550 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949769 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949774 2550 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949778 2550 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949783 2550 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949787 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949792 2550 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949817 2550 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949822 2550 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949827 2550 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949832 2550 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.949836 2550 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950319 2550 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950347 2550 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950354 2550 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950359 2550 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950365 2550 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950370 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:48:36.952866 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950375 2550 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950380 2550 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950388 2550 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950396 2550 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950401 2550 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950405 2550 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950415 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950419 2550 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950436 2550 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950452 2550 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950456 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950459 2550 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950462 2550 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950465 2550 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950482 2550 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950486 2550 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950489 2550 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950492 2550 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950498 2550 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:48:36.953351 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950501 2550 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950504 2550 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950522 2550 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950545 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950553 2550 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950661 2550 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950665 2550 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950669 2550 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950673 2550 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950676 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950679 2550 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950681 2550 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:36.950685 2550 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.950693 2550 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.950860 2550 server.go:962] "Client rotation is on, will bootstrap in background" Jun 16 19:48:36.953859 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.953316 2550 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 16 19:48:36.955083 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.955072 2550 server.go:1019] "Starting client certificate rotation" Jun 16 19:48:36.955186 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.955170 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:48:36.955221 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.955207 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:48:36.957979 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.957966 2550 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:48:36.959146 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.959130 2550 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:48:36.970260 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.970242 2550 log.go:25] "Validated CRI v1 runtime API" Jun 16 19:48:36.974599 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.974580 2550 log.go:25] "Validated CRI v1 image API" Jun 16 19:48:36.975441 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.975418 2550 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 16 19:48:36.979717 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.979694 2550 fs.go:135] Filesystem UUIDs: map[3f5f7cd6-fa1e-4728-b855-6dade6e404e6:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 8d7c0e26-d710-4584-9e33-aa3584ba0131:/dev/nvme0n1p3] Jun 16 19:48:36.979841 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.979816 2550 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 16 19:48:36.986353 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.986169 2550 manager.go:216] Machine: {Timestamp:2026-06-16 19:48:36.98470435 +0000 UTC m=+0.378697046 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099578 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25f584ead6aca4325a97498580e9ca SystemUUID:ec25f584-ead6-aca4-325a-97498580e9ca BootID:70589a34-97bd-464d-bcbd-ffa19ec6ef2a Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2b:c5:7b:4f:c3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2b:c5:7b:4f:c3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:29:03:5c:ad:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 16 19:48:36.986353 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.986338 2550 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 16 19:48:36.986512 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.986458 2550 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 16 19:48:36.988956 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.988939 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:48:36.989896 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.989874 2550 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 16 19:48:36.990040 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.989900 2550 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 16 19:48:36.990846 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.990834 2550 topology_manager.go:138] "Creating topology manager with none policy" Jun 16 19:48:36.990887 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.990850 2550 container_manager_linux.go:309] "Creating device plugin manager" Jun 16 19:48:36.990887 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.990857 2550 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:48:36.990887 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.990877 2550 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:48:36.992170 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.992160 2550 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 16 19:48:36.997213 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997201 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:48:36.997326 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997317 2550 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 16 19:48:36.997358 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997347 2550 kubelet.go:486] "Attempting to sync node with API server" Jun 16 19:48:36.997385 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997363 2550 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 16 19:48:36.997385 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997381 2550 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 16 19:48:36.997440 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997392 2550 kubelet.go:398] "Adding apiserver pod source" Jun 16 19:48:36.997440 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997402 2550 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 16 19:48:36.997799 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997786 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:48:36.997862 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:36.997806 2550 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:48:37.002185 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.002170 2550 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 16 19:48:37.003898 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.003883 2550 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 16 19:48:37.003968 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.003913 2550 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 16 19:48:37.004753 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004741 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004757 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004763 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004768 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004776 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004782 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004793 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004800 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 16 19:48:37.004807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004808 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 16 19:48:37.005017 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004814 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 16 19:48:37.005017 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004826 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 16 19:48:37.005017 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.004832 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 16 19:48:37.005694 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.005684 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 16 19:48:37.005694 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.005693 2550 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 16 19:48:37.009114 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.009098 2550 server.go:1268] "Started kubelet" Jun 16 19:48:37.009225 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.009167 2550 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 16 19:48:37.009277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.009202 2550 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 16 19:48:37.009326 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.009305 2550 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 16 19:48:37.009866 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.009846 2550 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:48:37.009945 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.009858 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 16 19:48:37.010009 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.009953 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 16 19:48:37.010069 ip-10-0-138-253 systemd[1]: Started Kubernetes Kubelet. Jun 16 19:48:37.011119 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.011106 2550 server.go:310] "Adding debug handlers to kubelet server" Jun 16 19:48:37.011831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.011668 2550 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 16 19:48:37.016897 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.016882 2550 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 16 19:48:37.017020 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.017000 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.017090 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017052 2550 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 16 19:48:37.017789 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017771 2550 factory.go:55] Registering systemd factory Jun 16 19:48:37.017789 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.017785 2550 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017792 2550 factory.go:223] Registration of the systemd container factory successfully Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017814 2550 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017817 2550 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017836 2550 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017909 2550 reconstruct.go:97] "Volume reconstruction finished" Jun 16 19:48:37.017923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017916 2550 reconciler.go:29] "Reconciler: start to sync state" Jun 16 19:48:37.018177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017973 2550 factory.go:153] Registering CRI-O factory Jun 16 19:48:37.018177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.017981 2550 factory.go:223] Registration of the crio container factory successfully Jun 16 19:48:37.018177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.018082 2550 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 16 19:48:37.018177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.018104 2550 factory.go:103] Registering Raw factory Jun 16 19:48:37.018177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.018119 2550 manager.go:1196] Started watching for new ooms in manager Jun 16 19:48:37.018789 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.018717 2550 manager.go:349] Starting recovery of all containers Jun 16 19:48:37.018857 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.017631 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f031e99b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.009066395 +0000 UTC m=+0.403059096,LastTimestamp:2026-06-16 19:48:37.009066395 +0000 UTC m=+0.403059096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.023366 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.023336 2550 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 16 19:48:37.023553 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.023531 2550 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 16 19:48:37.030643 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.030540 2550 manager.go:354] Recovery completed Jun 16 19:48:37.034739 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.034722 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.037248 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037224 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.037318 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037267 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.037318 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037279 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.037834 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037819 2550 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 16 19:48:37.037884 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037836 2550 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 16 19:48:37.037884 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037855 2550 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:48:37.037884 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.037857 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.038647 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.038634 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.038697 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.038658 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.038697 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.038668 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.039744 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.039675 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f1dff0ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.037248683 +0000 UTC m=+0.431241383,LastTimestamp:2026-06-16 19:48:37.037248683 +0000 UTC m=+0.431241383,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.040180 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.040169 2550 policy_none.go:49] "None policy: Start" Jun 16 19:48:37.040213 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.040186 2550 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 16 19:48:37.040213 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.040196 2550 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 16 19:48:37.042327 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.042317 2550 policy_none.go:47] "Start" Jun 16 19:48:37.050051 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.049919 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f1e05078 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.037273208 +0000 UTC m=+0.431265904,LastTimestamp:2026-06-16 19:48:37.037273208 +0000 UTC m=+0.431265904,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.057999 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.057931 2550 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f1e07aa8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.037284008 +0000 UTC m=+0.431276704,LastTimestamp:2026-06-16 19:48:37.037284008 +0000 UTC m=+0.431276704,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.067171 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.067109 2550 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-253.ec2.internal.18b9a784f1dff0ab\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f1dff0ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.037248683 +0000 UTC m=+0.431241383,LastTimestamp:2026-06-16 19:48:37.03864626 +0000 UTC m=+0.432638957,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.072317 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.072296 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgk7c" Jun 16 19:48:37.078296 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.078233 2550 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-253.ec2.internal.18b9a784f1e05078\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-253.ec2.internal.18b9a784f1e05078 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-253.ec2.internal,UID:ip-10-0-138-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-253.ec2.internal,},FirstTimestamp:2026-06-16 19:48:37.037273208 +0000 UTC m=+0.431265904,LastTimestamp:2026-06-16 19:48:37.038662747 +0000 UTC m=+0.432655447,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-253.ec2.internal,}" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.080185 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lgk7c" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083029 2550 manager.go:337] "Starting Device Plugin manager" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.083058 2550 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083072 2550 server.go:87] "Starting device plugin registration server" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083327 2550 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083341 2550 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083452 2550 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083547 2550 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.083557 2550 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.084119 2550 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.084174 2550 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.087389 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.088656 2550 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.088689 2550 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.088710 2550 kubelet.go:2448] "Starting kubelet main sync loop" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.088745 2550 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 16 19:48:37.099316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.090938 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:48:37.184126 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.184046 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.185128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.185100 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.185237 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.185135 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.185237 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.185150 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.185237 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.185176 2550 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.189240 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.189219 2550 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal"] Jun 16 19:48:37.189315 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.189301 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.190136 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.190115 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.190136 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.190140 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.190304 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.190153 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.192643 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.192627 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.192753 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.192733 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.192798 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.192761 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.193668 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.193655 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.193753 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.193681 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.193753 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.193694 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.194298 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.194284 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.194357 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.194310 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.194357 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.194321 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.195980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.195964 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.196078 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.195994 2550 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:48:37.196763 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.196747 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:48:37.196841 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.196780 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:48:37.196841 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.196794 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:48:37.198496 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.198466 2550 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.198547 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.198503 2550 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-253.ec2.internal\": node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.219500 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.219455 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.219500 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.219507 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.219656 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.219525 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85636fa59369e3d60df062b040761869-config\") pod \"kube-apiserver-proxy-ip-10-0-138-253.ec2.internal\" (UID: \"85636fa59369e3d60df062b040761869\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.220103 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.220085 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-253.ec2.internal\" not found" node="ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.224820 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.224806 2550 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-253.ec2.internal\" not found" node="ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.284548 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.284519 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.320614 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320589 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.320614 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320618 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.320803 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320635 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85636fa59369e3d60df062b040761869-config\") pod \"kube-apiserver-proxy-ip-10-0-138-253.ec2.internal\" (UID: \"85636fa59369e3d60df062b040761869\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.320803 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320662 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/85636fa59369e3d60df062b040761869-config\") pod \"kube-apiserver-proxy-ip-10-0-138-253.ec2.internal\" (UID: \"85636fa59369e3d60df062b040761869\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.320803 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320687 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.320803 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.320693 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ced422cb6ec4b20529c2565dd72c69-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal\" (UID: \"58ced422cb6ec4b20529c2565dd72c69\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.384966 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.384930 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.485926 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.485833 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.523413 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.523376 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.528648 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.528632 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:37.586266 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.586224 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.686788 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.686758 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.787304 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.787245 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.887855 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.887810 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:37.954346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.954295 2550 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 16 19:48:37.955005 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:37.954488 2550 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 16 19:48:37.988617 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:37.988587 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:38.086043 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.085997 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-15 19:43:37 +0000 UTC" deadline="2028-03-21 09:10:55.852429544 +0000 UTC" Jun 16 19:48:38.086043 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.086032 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15445h22m17.766400757s" Jun 16 19:48:38.089167 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:38.089145 2550 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-253.ec2.internal\" not found" Jun 16 19:48:38.094312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.094279 2550 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:48:38.097601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.097580 2550 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:48:38.117484 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.117445 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" Jun 16 19:48:38.140242 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.140215 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:48:38.141293 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.141277 2550 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" Jun 16 19:48:38.153420 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.153390 2550 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:48:38.191217 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:38.191190 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ced422cb6ec4b20529c2565dd72c69.slice/crio-2bbd654ff7e26ad148819d6325fec46a2283505178418e6214597a93d1405f93 WatchSource:0}: Error finding container 2bbd654ff7e26ad148819d6325fec46a2283505178418e6214597a93d1405f93: Status 404 returned error can't find the container with id 2bbd654ff7e26ad148819d6325fec46a2283505178418e6214597a93d1405f93 Jun 16 19:48:38.193063 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:38.193034 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85636fa59369e3d60df062b040761869.slice/crio-873badf6dfd3bb2076b5250327c2c4acfbc85cf632fef13e58db3c3b1581dde8 WatchSource:0}: Error finding container 873badf6dfd3bb2076b5250327c2c4acfbc85cf632fef13e58db3c3b1581dde8: Status 404 returned error can't find the container with id 873badf6dfd3bb2076b5250327c2c4acfbc85cf632fef13e58db3c3b1581dde8 Jun 16 19:48:38.198022 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.198002 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:48:38.514769 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.514687 2550 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:48:38.998071 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:38.997989 2550 apiserver.go:52] "Watching apiserver" Jun 16 19:48:39.005823 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.005797 2550 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 16 19:48:39.006212 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.006185 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-lbx28","kube-system/konnectivity-agent-hxjx5","kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm","openshift-cluster-node-tuning-operator/tuned-mq6jj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal","openshift-multus/multus-additional-cni-plugins-5775w","openshift-ovn-kubernetes/ovnkube-node-94ss8","openshift-dns/node-resolver-hrtjn","openshift-image-registry/node-ca-7d67j","openshift-multus/multus-zbgwm","openshift-multus/network-metrics-daemon-lh5r9","openshift-network-diagnostics/network-check-target-9xq5j","openshift-network-operator/iptables-alerter-cnpk9"] Jun 16 19:48:39.008771 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.008749 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.010988 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.010881 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:39.010988 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.010958 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:39.013767 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.013745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.016518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.016235 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.016518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.016423 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 16 19:48:39.016934 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.016912 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 16 19:48:39.017039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.016970 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 16 19:48:39.017293 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017174 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.017293 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017205 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.017719 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017698 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fgtds\"" Jun 16 19:48:39.017813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017725 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.017813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017733 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 16 19:48:39.017813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017808 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.017959 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.017734 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zsdgn\"" Jun 16 19:48:39.018036 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.018021 2550 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 16 19:48:39.018812 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.018549 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.021385 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.021349 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.023067 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023041 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.023283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023266 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k2h9l\"" Jun 16 19:48:39.023360 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023335 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.023827 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023591 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 16 19:48:39.023929 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023837 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.023929 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023855 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cmkz\"" Jun 16 19:48:39.024034 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.023840 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.024084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.024073 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.025856 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.025834 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 16 19:48:39.025948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.025860 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 16 19:48:39.025948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.025933 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.026338 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026314 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 16 19:48:39.026506 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026489 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.026626 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026489 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 16 19:48:39.026626 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026622 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2hcr\"" Jun 16 19:48:39.026741 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026677 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.026741 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026682 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.026741 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026733 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cdrc8\"" Jun 16 19:48:39.026864 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.026832 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.026906 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.026885 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:39.028820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.028803 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.029920 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.029901 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x22r\" (UniqueName: \"kubernetes.io/projected/d18263e1-e465-4399-bb1d-81d162d3f17b-kube-api-access-7x22r\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.029932 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysconfig\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.029949 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-systemd\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.029974 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-os-release\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030002 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030028 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10b5865c-03c2-4bfd-8edc-90a066695347-iptables-alerter-script\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030049 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-registration-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030071 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-run\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030093 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-var-lib-kubelet\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030114 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-tmp\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030137 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030153 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030190 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030237 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpfph\" (UniqueName: \"kubernetes.io/projected/35b195fc-bc90-4305-ab88-5ecd049fb77e-kube-api-access-mpfph\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030268 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-kubernetes\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030290 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030317 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-cnibin\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030340 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-socket-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030373 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030396 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-host\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030431 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030464 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-conf\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030580 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030623 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10b5865c-03c2-4bfd-8edc-90a066695347-host-slash\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-tuned\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030671 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-system-cni-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030698 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vk54\" (UniqueName: \"kubernetes.io/projected/10b5865c-03c2-4bfd-8edc-90a066695347-kube-api-access-9vk54\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030723 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-modprobe-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030748 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-sys\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030773 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sb74\" (UniqueName: \"kubernetes.io/projected/f9f53575-b3b2-45d9-ad12-d79e35ed1283-kube-api-access-5sb74\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030808 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-device-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030831 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-sys-fs\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.030942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.030852 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-lib-modules\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.031499 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.031228 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.031917 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.031886 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hztzm\"" Jun 16 19:48:39.032055 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.032037 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 16 19:48:39.032254 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.032237 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 16 19:48:39.033832 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.033814 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.034189 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.034169 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 16 19:48:39.034292 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.034258 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 16 19:48:39.034482 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.034445 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 16 19:48:39.034629 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.034504 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xcpzm\"" Jun 16 19:48:39.035158 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.035139 2550 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:48:39.035994 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.035977 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.036095 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.036042 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:39.038751 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.038734 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bp92p\"" Jun 16 19:48:39.039047 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.038794 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 16 19:48:39.072223 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.072196 2550 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhjd9" Jun 16 19:48:39.085328 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.085259 2550 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fhjd9" Jun 16 19:48:39.094240 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.094165 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" event={"ID":"85636fa59369e3d60df062b040761869","Type":"ContainerStarted","Data":"873badf6dfd3bb2076b5250327c2c4acfbc85cf632fef13e58db3c3b1581dde8"} Jun 16 19:48:39.095641 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.095576 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" event={"ID":"58ced422cb6ec4b20529c2565dd72c69","Type":"ContainerStarted","Data":"2bbd654ff7e26ad148819d6325fec46a2283505178418e6214597a93d1405f93"} Jun 16 19:48:39.119264 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.119197 2550 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 16 19:48:39.131759 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131728 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-sys\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131770 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sb74\" (UniqueName: \"kubernetes.io/projected/f9f53575-b3b2-45d9-ad12-d79e35ed1283-kube-api-access-5sb74\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131800 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-serviceca\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131824 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131848 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-bin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131870 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-node-log\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131896 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k29wm\" (UniqueName: \"kubernetes.io/projected/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-kube-api-access-k29wm\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.131945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131923 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvc65\" (UniqueName: \"kubernetes.io/projected/c0a04b50-3f53-4adb-8f5d-e417de7e35de-kube-api-access-kvc65\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131967 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-sys-fs\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132034 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-sys-fs\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132048 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-lib-modules\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132083 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33adf1cd-f0af-48f7-97f0-7b56d140e065-agent-certs\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132110 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-etc-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132136 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132162 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0a04b50-3f53-4adb-8f5d-e417de7e35de-hosts-file\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132193 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-lib-modules\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132195 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132244 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x22r\" (UniqueName: \"kubernetes.io/projected/d18263e1-e465-4399-bb1d-81d162d3f17b-kube-api-access-7x22r\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132271 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-system-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132297 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-socket-dir-parent\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.131872 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-sys\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132320 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-systemd-units\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132360 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-netns\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132411 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-os-release\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132460 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10b5865c-03c2-4bfd-8edc-90a066695347-iptables-alerter-script\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132497 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-run\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132528 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-tmp\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132552 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8nnw\" (UniqueName: \"kubernetes.io/projected/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-kube-api-access-l8nnw\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132554 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-os-release\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132574 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-os-release\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132600 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-kubelet\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132609 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-run\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132714 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cni-binary-copy\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132761 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-hostroot\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132786 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr4wz\" (UniqueName: \"kubernetes.io/projected/f4fab3c8-424b-4219-958f-0cdd1a58fa78-kube-api-access-zr4wz\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132810 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.132867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132835 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fkn\" (UniqueName: \"kubernetes.io/projected/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-kube-api-access-z7fkn\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132859 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-bin\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132882 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-netd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132906 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-dbus\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132933 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-socket-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132945 2550 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.132957 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-etc-selinux\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133043 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-host\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133072 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a04b50-3f53-4adb-8f5d-e417de7e35de-tmp-dir\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133088 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-socket-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133100 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133138 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-conf\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133144 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-host\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133153 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/10b5865c-03c2-4bfd-8edc-90a066695347-iptables-alerter-script\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133166 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133190 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.133754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133194 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10b5865c-03c2-4bfd-8edc-90a066695347-host-slash\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133220 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-var-lib-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133252 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-system-cni-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133274 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/10b5865c-03c2-4bfd-8edc-90a066695347-host-slash\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133303 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-conf\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133322 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vk54\" (UniqueName: \"kubernetes.io/projected/10b5865c-03c2-4bfd-8edc-90a066695347-kube-api-access-9vk54\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133349 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-system-cni-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133387 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-modprobe-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133416 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-config\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133442 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-device-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133492 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-k8s-cni-cncf-io\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133515 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-device-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133517 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysconfig\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133566 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysconfig\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133566 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-systemd\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133608 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-systemd\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133608 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-netns\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.134557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133646 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-conf-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133670 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-daemon-config\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133692 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-modprobe-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133696 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133744 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-registration-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133768 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-var-lib-kubelet\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133794 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-multus-certs\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133818 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-etc-kubernetes\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133842 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-ovn\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133858 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-var-lib-kubelet\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133865 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133816 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d18263e1-e465-4399-bb1d-81d162d3f17b-registration-dir\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.133905 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-kubelet-config\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134589 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134648 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134683 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134716 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpfph\" (UniqueName: \"kubernetes.io/projected/35b195fc-bc90-4305-ab88-5ecd049fb77e-kube-api-access-mpfph\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134743 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-kubernetes\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134775 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134808 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-multus\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134839 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-slash\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134868 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-cnibin\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134888 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-systemd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134912 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134944 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-script-lib\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.134978 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33adf1cd-f0af-48f7-97f0-7b56d140e065-konnectivity-ca\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135008 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-host\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135040 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-kubelet\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135066 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-env-overrides\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135097 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-tuned\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135113 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135127 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cnibin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135219 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-log-socket\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.135996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135258 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovn-node-metrics-cert\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.136820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.135662 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.136820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.136118 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-kubernetes\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.136820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.136244 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-sysctl-d\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.136820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.136295 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-cnibin\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.136820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.136440 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/35b195fc-bc90-4305-ab88-5ecd049fb77e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.139111 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.139085 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-tmp\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.139269 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.139250 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f9f53575-b3b2-45d9-ad12-d79e35ed1283-etc-tuned\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.140206 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.140126 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/35b195fc-bc90-4305-ab88-5ecd049fb77e-cni-binary-copy\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.147976 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.147779 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:39.147976 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.147806 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:39.147976 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.147820 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:39.147976 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.147900 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:39.647875786 +0000 UTC m=+3.041868493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:39.151817 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.151768 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpfph\" (UniqueName: \"kubernetes.io/projected/35b195fc-bc90-4305-ab88-5ecd049fb77e-kube-api-access-mpfph\") pod \"multus-additional-cni-plugins-5775w\" (UID: \"35b195fc-bc90-4305-ab88-5ecd049fb77e\") " pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.151955 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.151777 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x22r\" (UniqueName: \"kubernetes.io/projected/d18263e1-e465-4399-bb1d-81d162d3f17b-kube-api-access-7x22r\") pod \"aws-ebs-csi-driver-node-q2xwm\" (UID: \"d18263e1-e465-4399-bb1d-81d162d3f17b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.153769 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.153745 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sb74\" (UniqueName: \"kubernetes.io/projected/f9f53575-b3b2-45d9-ad12-d79e35ed1283-kube-api-access-5sb74\") pod \"tuned-mq6jj\" (UID: \"f9f53575-b3b2-45d9-ad12-d79e35ed1283\") " pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.155632 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.155607 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vk54\" (UniqueName: \"kubernetes.io/projected/10b5865c-03c2-4bfd-8edc-90a066695347-kube-api-access-9vk54\") pod \"iptables-alerter-cnpk9\" (UID: \"10b5865c-03c2-4bfd-8edc-90a066695347\") " pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.236457 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236413 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-multus\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.236457 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236459 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-slash\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236502 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-systemd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236526 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236551 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-script-lib\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236573 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33adf1cd-f0af-48f7-97f0-7b56d140e065-konnectivity-ca\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236607 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-host\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236636 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-kubelet\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236639 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-slash\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236658 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-env-overrides\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236683 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cnibin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236703 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-log-socket\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.236703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236706 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236723 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovn-node-metrics-cert\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236746 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-serviceca\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236752 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-multus\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236770 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236793 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-bin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-node-log\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236837 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k29wm\" (UniqueName: \"kubernetes.io/projected/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-kube-api-access-k29wm\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236861 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvc65\" (UniqueName: \"kubernetes.io/projected/c0a04b50-3f53-4adb-8f5d-e417de7e35de-kube-api-access-kvc65\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236886 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33adf1cd-f0af-48f7-97f0-7b56d140e065-agent-certs\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236907 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-etc-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236931 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236957 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0a04b50-3f53-4adb-8f5d-e417de7e35de-hosts-file\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.236988 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-system-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237040 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-socket-dir-parent\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237064 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-systemd-units\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.237247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237089 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-netns\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237120 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8nnw\" (UniqueName: \"kubernetes.io/projected/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-kube-api-access-l8nnw\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237144 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-os-release\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237167 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-kubelet\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237191 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cni-binary-copy\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237217 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-hostroot\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237223 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-env-overrides\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237244 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr4wz\" (UniqueName: \"kubernetes.io/projected/f4fab3c8-424b-4219-958f-0cdd1a58fa78-kube-api-access-zr4wz\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237247 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-script-lib\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237271 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237292 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-host\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237292 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/33adf1cd-f0af-48f7-97f0-7b56d140e065-konnectivity-ca\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237297 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fkn\" (UniqueName: \"kubernetes.io/projected/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-kube-api-access-z7fkn\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237350 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c0a04b50-3f53-4adb-8f5d-e417de7e35de-hosts-file\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237363 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-bin\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237383 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-os-release\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237388 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-netd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237403 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cnibin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237405 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-kubelet\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237442 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-netd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237446 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-systemd\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237447 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-log-socket\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.237508 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237535 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-systemd-units\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.237561 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.237574 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:39.737555373 +0000 UTC m=+3.131548058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237589 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-system-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.237620 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:39.737603905 +0000 UTC m=+3.131596606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237642 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-socket-dir-parent\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237319 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-kubelet\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237716 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-netns\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237363 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-hostroot\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237747 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-dbus\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237774 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-cni-bin\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237781 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a04b50-3f53-4adb-8f5d-e417de7e35de-tmp-dir\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.238833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237810 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-node-log\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-var-lib-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237858 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-config\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237885 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-k8s-cni-cncf-io\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237916 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-netns\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237939 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-conf-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237962 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-daemon-config\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237987 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-multus-certs\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238009 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-etc-kubernetes\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238035 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-ovn\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238059 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238082 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-kubelet-config\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238166 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-kubelet-config\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238183 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-dbus\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238207 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-var-lib-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238251 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-multus-certs\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238273 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-serviceca\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238295 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-etc-kubernetes\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.239644 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238059 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c0a04b50-3f53-4adb-8f5d-e417de7e35de-tmp-dir\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.237885 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-cni-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238332 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-run-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238377 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-run-ovn\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238417 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-k8s-cni-cncf-io\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238454 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-run-netns\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238508 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-conf-dir\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238720 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-multus-daemon-config\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238782 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f4fab3c8-424b-4219-958f-0cdd1a58fa78-host-var-lib-cni-bin\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238801 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovnkube-config\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238813 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f4fab3c8-424b-4219-958f-0cdd1a58fa78-cni-binary-copy\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238829 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-etc-openvswitch\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.240532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.238860 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.242088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.242032 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/33adf1cd-f0af-48f7-97f0-7b56d140e065-agent-certs\") pod \"konnectivity-agent-hxjx5\" (UID: \"33adf1cd-f0af-48f7-97f0-7b56d140e065\") " pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.242292 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.242273 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-ovn-node-metrics-cert\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.248761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.248703 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr4wz\" (UniqueName: \"kubernetes.io/projected/f4fab3c8-424b-4219-958f-0cdd1a58fa78-kube-api-access-zr4wz\") pod \"multus-zbgwm\" (UID: \"f4fab3c8-424b-4219-958f-0cdd1a58fa78\") " pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.250263 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.250241 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8nnw\" (UniqueName: \"kubernetes.io/projected/856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3-kube-api-access-l8nnw\") pod \"node-ca-7d67j\" (UID: \"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3\") " pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.250831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.250808 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k29wm\" (UniqueName: \"kubernetes.io/projected/dfc5e889-c0a5-4b6f-b6fb-242a999f1f64-kube-api-access-k29wm\") pod \"ovnkube-node-94ss8\" (UID: \"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64\") " pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.251594 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.251355 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fkn\" (UniqueName: \"kubernetes.io/projected/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-kube-api-access-z7fkn\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.252062 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.252036 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvc65\" (UniqueName: \"kubernetes.io/projected/c0a04b50-3f53-4adb-8f5d-e417de7e35de-kube-api-access-kvc65\") pod \"node-resolver-hrtjn\" (UID: \"c0a04b50-3f53-4adb-8f5d-e417de7e35de\") " pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.321017 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.320742 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5775w" Jun 16 19:48:39.335929 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.335899 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cnpk9" Jun 16 19:48:39.344851 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.344825 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" Jun 16 19:48:39.350460 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.350437 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" Jun 16 19:48:39.358277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.358251 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:48:39.364959 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.364938 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hrtjn" Jun 16 19:48:39.373571 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.373554 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:48:39.381168 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.381146 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7d67j" Jun 16 19:48:39.387852 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.387823 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zbgwm" Jun 16 19:48:39.460657 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.460627 2550 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:48:39.742077 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.741996 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:39.742077 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.742042 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:39.742306 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:39.742141 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:39.742306 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742163 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:39.742306 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742236 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:40.742215015 +0000 UTC m=+4.136207715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:39.742306 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742244 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:39.742306 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742305 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:40.742288205 +0000 UTC m=+4.136280895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:39.742536 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742251 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:39.742536 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742345 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:39.742536 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742360 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:39.742536 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:39.742408 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:40.742395714 +0000 UTC m=+4.136388406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:40.089791 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.089693 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:43:39 +0000 UTC" deadline="2028-02-29 00:33:36.947503462 +0000 UTC" Jun 16 19:48:40.089791 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.089736 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14932h44m56.857772203s" Jun 16 19:48:40.090238 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.089871 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:40.090238 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.089904 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:40.090238 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.090009 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:40.090238 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.090138 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:40.397690 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.397657 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10b5865c_03c2_4bfd_8edc_90a066695347.slice/crio-365f6ee151652ed54379f0078ce249a07286eefa86440f3d5736aec0a7538ec0 WatchSource:0}: Error finding container 365f6ee151652ed54379f0078ce249a07286eefa86440f3d5736aec0a7538ec0: Status 404 returned error can't find the container with id 365f6ee151652ed54379f0078ce249a07286eefa86440f3d5736aec0a7538ec0 Jun 16 19:48:40.399981 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.399790 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33adf1cd_f0af_48f7_97f0_7b56d140e065.slice/crio-9793012f23787f9d48d45b3f9320a837eeca15b4556401c2f0a7dc87a111624a WatchSource:0}: Error finding container 9793012f23787f9d48d45b3f9320a837eeca15b4556401c2f0a7dc87a111624a: Status 404 returned error can't find the container with id 9793012f23787f9d48d45b3f9320a837eeca15b4556401c2f0a7dc87a111624a Jun 16 19:48:40.402600 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.402512 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9f53575_b3b2_45d9_ad12_d79e35ed1283.slice/crio-84607c27186317b337774c0b56a6001670125cfc98e4a8add345b68ce7be6c64 WatchSource:0}: Error finding container 84607c27186317b337774c0b56a6001670125cfc98e4a8add345b68ce7be6c64: Status 404 returned error can't find the container with id 84607c27186317b337774c0b56a6001670125cfc98e4a8add345b68ce7be6c64 Jun 16 19:48:40.406087 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.406068 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b195fc_bc90_4305_ab88_5ecd049fb77e.slice/crio-c17b804784440f895ac4a128ca983bdc81bd3d33ee9b9849c91d7fad3119073e WatchSource:0}: Error finding container c17b804784440f895ac4a128ca983bdc81bd3d33ee9b9849c91d7fad3119073e: Status 404 returned error can't find the container with id c17b804784440f895ac4a128ca983bdc81bd3d33ee9b9849c91d7fad3119073e Jun 16 19:48:40.406994 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.406971 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856ecf31_1cc2_4d36_a00f_3a1a16b6c9c3.slice/crio-d8df1113acbdd615635e4bac5c6028ecfcb3c64fb145c8b9a709182c745a563c WatchSource:0}: Error finding container d8df1113acbdd615635e4bac5c6028ecfcb3c64fb145c8b9a709182c745a563c: Status 404 returned error can't find the container with id d8df1113acbdd615635e4bac5c6028ecfcb3c64fb145c8b9a709182c745a563c Jun 16 19:48:40.407932 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.407913 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4fab3c8_424b_4219_958f_0cdd1a58fa78.slice/crio-e2e6d79820d968d1ff885ae44841ca70963c6cf8cb0a0ca7869f83d0c2ed064f WatchSource:0}: Error finding container e2e6d79820d968d1ff885ae44841ca70963c6cf8cb0a0ca7869f83d0c2ed064f: Status 404 returned error can't find the container with id e2e6d79820d968d1ff885ae44841ca70963c6cf8cb0a0ca7869f83d0c2ed064f Jun 16 19:48:40.408850 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.408744 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc5e889_c0a5_4b6f_b6fb_242a999f1f64.slice/crio-7bd476501a126021c32e8e916cdfd8473981d8c96e7a23b7af87c037be99fb9b WatchSource:0}: Error finding container 7bd476501a126021c32e8e916cdfd8473981d8c96e7a23b7af87c037be99fb9b: Status 404 returned error can't find the container with id 7bd476501a126021c32e8e916cdfd8473981d8c96e7a23b7af87c037be99fb9b Jun 16 19:48:40.409726 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.409625 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18263e1_e465_4399_bb1d_81d162d3f17b.slice/crio-e0c120535e387d19aea01c6bd7c8082c3141e4f1cac2f9dd8370824a57793ea4 WatchSource:0}: Error finding container e0c120535e387d19aea01c6bd7c8082c3141e4f1cac2f9dd8370824a57793ea4: Status 404 returned error can't find the container with id e0c120535e387d19aea01c6bd7c8082c3141e4f1cac2f9dd8370824a57793ea4 Jun 16 19:48:40.410910 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:48:40.410682 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a04b50_3f53_4adb_8f5d_e417de7e35de.slice/crio-f7019adaa2dddb76368788c0b367dc9037b6028ddd02432d32453ba621bf1bc9 WatchSource:0}: Error finding container f7019adaa2dddb76368788c0b367dc9037b6028ddd02432d32453ba621bf1bc9: Status 404 returned error can't find the container with id f7019adaa2dddb76368788c0b367dc9037b6028ddd02432d32453ba621bf1bc9 Jun 16 19:48:40.748283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.748251 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:40.748283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.748289 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:40.748320 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748403 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748414 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748431 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748445 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748457 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748482 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:42.748448908 +0000 UTC m=+6.142441607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748500 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:42.74849132 +0000 UTC m=+6.142484007 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:40.748516 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:40.748513 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:42.748506528 +0000 UTC m=+6.142499212 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:41.089381 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.089305 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:41.089548 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:41.089445 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:41.089933 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.089883 2550 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:43:39 +0000 UTC" deadline="2028-02-09 07:15:19.994954905 +0000 UTC" Jun 16 19:48:41.089933 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.089933 2550 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14459h26m38.905025151s" Jun 16 19:48:41.102773 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.102711 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbgwm" event={"ID":"f4fab3c8-424b-4219-958f-0cdd1a58fa78","Type":"ContainerStarted","Data":"e2e6d79820d968d1ff885ae44841ca70963c6cf8cb0a0ca7869f83d0c2ed064f"} Jun 16 19:48:41.106766 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.106735 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnpk9" event={"ID":"10b5865c-03c2-4bfd-8edc-90a066695347","Type":"ContainerStarted","Data":"365f6ee151652ed54379f0078ce249a07286eefa86440f3d5736aec0a7538ec0"} Jun 16 19:48:41.111944 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.111913 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" event={"ID":"85636fa59369e3d60df062b040761869","Type":"ContainerStarted","Data":"95508575f7923d2101ddcd2e452ebe817da036792a4c337d174cc3eb7dde1a3f"} Jun 16 19:48:41.125242 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.124528 2550 generic.go:356] "Generic (PLEG): container finished" podID="58ced422cb6ec4b20529c2565dd72c69" containerID="a05fce0e9fa826058f23338ac33e9ea829d897cfa757e0e4ee6a283fa2aca332" exitCode=0 Jun 16 19:48:41.125242 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.124653 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" event={"ID":"58ced422cb6ec4b20529c2565dd72c69","Type":"ContainerDied","Data":"a05fce0e9fa826058f23338ac33e9ea829d897cfa757e0e4ee6a283fa2aca332"} Jun 16 19:48:41.128026 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.128001 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrtjn" event={"ID":"c0a04b50-3f53-4adb-8f5d-e417de7e35de","Type":"ContainerStarted","Data":"f7019adaa2dddb76368788c0b367dc9037b6028ddd02432d32453ba621bf1bc9"} Jun 16 19:48:41.129524 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.129501 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7d67j" event={"ID":"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3","Type":"ContainerStarted","Data":"d8df1113acbdd615635e4bac5c6028ecfcb3c64fb145c8b9a709182c745a563c"} Jun 16 19:48:41.132619 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.132597 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerStarted","Data":"c17b804784440f895ac4a128ca983bdc81bd3d33ee9b9849c91d7fad3119073e"} Jun 16 19:48:41.139163 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.139136 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" event={"ID":"f9f53575-b3b2-45d9-ad12-d79e35ed1283","Type":"ContainerStarted","Data":"84607c27186317b337774c0b56a6001670125cfc98e4a8add345b68ce7be6c64"} Jun 16 19:48:41.141800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.141773 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxjx5" event={"ID":"33adf1cd-f0af-48f7-97f0-7b56d140e065","Type":"ContainerStarted","Data":"9793012f23787f9d48d45b3f9320a837eeca15b4556401c2f0a7dc87a111624a"} Jun 16 19:48:41.143322 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.143296 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" event={"ID":"d18263e1-e465-4399-bb1d-81d162d3f17b","Type":"ContainerStarted","Data":"e0c120535e387d19aea01c6bd7c8082c3141e4f1cac2f9dd8370824a57793ea4"} Jun 16 19:48:41.144873 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.144848 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"7bd476501a126021c32e8e916cdfd8473981d8c96e7a23b7af87c037be99fb9b"} Jun 16 19:48:41.153005 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:41.152945 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-253.ec2.internal" podStartSLOduration=3.152928091 podStartE2EDuration="3.152928091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:48:41.131992923 +0000 UTC m=+4.525985641" watchObservedRunningTime="2026-06-16 19:48:41.152928091 +0000 UTC m=+4.546920800" Jun 16 19:48:42.089725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.089639 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:42.089725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.089682 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:42.089934 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.089788 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:42.089992 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.089926 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:42.175044 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.175004 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" event={"ID":"58ced422cb6ec4b20529c2565dd72c69","Type":"ContainerStarted","Data":"5816c649ca6a7a49cad502d98af9a1dc2a3984783c5984eea51eab32c00c7347"} Jun 16 19:48:42.766544 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.766502 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:42.766725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.766569 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:42.766725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:42.766635 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:42.766725 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766664 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766738 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:46.766717256 +0000 UTC m=+10.160709942 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766740 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766779 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:46.766768897 +0000 UTC m=+10.160761586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766811 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766831 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:42.766886 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766843 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:42.767176 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:42.766892 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:46.766876261 +0000 UTC m=+10.160868953 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:43.092346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:43.092274 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:43.092783 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:43.092410 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:44.090015 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:44.089806 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:44.090015 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:44.089846 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:44.090015 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:44.089952 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:44.090285 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:44.090086 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:45.090074 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:45.089752 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:45.090074 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:45.089888 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:46.089178 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:46.089141 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:46.089178 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:46.089177 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:46.089455 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.089288 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:46.089455 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.089430 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:46.804679 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:46.804640 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:46.804696 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:46.804733 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804822 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804898 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:54.80487798 +0000 UTC m=+18.198870670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804911 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804930 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804942 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:46.805035 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.804996 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:54.804981474 +0000 UTC m=+18.198974161 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:46.805360 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.805060 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:46.805360 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:46.805092 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:48:54.805080735 +0000 UTC m=+18.199073425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:47.090955 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:47.090875 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:47.091109 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:47.090990 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:48.088907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:48.088877 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:48.089293 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:48.088983 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:48.089352 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:48.089319 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:48.089433 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:48.089415 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:49.089948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:49.089912 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:49.090417 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:49.090054 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:50.089128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:50.089075 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:50.089325 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:50.089075 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:50.089325 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:50.089198 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:50.089461 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:50.089317 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:51.089892 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:51.089812 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:51.090321 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:51.089935 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:52.089217 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:52.089178 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:52.089389 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:52.089218 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:52.089389 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:52.089297 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:52.089503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:52.089424 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:53.089718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:53.089685 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:53.090123 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:53.089788 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:54.089621 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:54.089587 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:54.089825 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:54.089587 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:54.089825 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.089707 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:54.089825 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.089795 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:54.871710 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:54.871679 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:54.871889 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:54.871720 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:54.871889 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:54.871746 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:54.871889 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871835 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:54.871889 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871873 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871894 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871908 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871839 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871908 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.871887606 +0000 UTC m=+34.265880291 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871966 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.871955872 +0000 UTC m=+34.265948557 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:48:54.872056 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:54.871982 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.871974369 +0000 UTC m=+34.265967054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:48:55.089825 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:55.089792 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:55.090319 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:55.089941 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:56.089301 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:56.089266 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:56.089505 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:56.089394 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:56.089616 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:56.089266 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:56.089742 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:56.089721 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:57.090740 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:57.090702 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:57.091289 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:57.090824 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:48:58.089198 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:58.089160 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:48:58.089198 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:58.089186 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:48:58.089440 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:58.089296 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:48:58.089440 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:58.089401 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:48:59.089422 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:48:59.089387 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:48:59.089846 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:48:59.089510 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:00.090266 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.089936 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:00.091101 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.089965 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:00.091101 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:00.090381 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:00.091101 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:00.090397 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:00.213350 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.213314 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hrtjn" event={"ID":"c0a04b50-3f53-4adb-8f5d-e417de7e35de","Type":"ContainerStarted","Data":"b80af19b2d09a1c1804afe30d6e263e8fc8062a14fb558bb06a7e441c1c4c717"} Jun 16 19:49:00.215125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.215094 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7d67j" event={"ID":"856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3","Type":"ContainerStarted","Data":"2ea34401b8a38c324521ee0d6fd71a3a40fd769f33ad3cf28b868f76c2f94d67"} Jun 16 19:49:00.216882 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.216852 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="5530040d0dfc31ec07759e16c691c5c2fc9e80f69a56200cb7aff3ef4a274378" exitCode=0 Jun 16 19:49:00.217016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.216940 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"5530040d0dfc31ec07759e16c691c5c2fc9e80f69a56200cb7aff3ef4a274378"} Jun 16 19:49:00.220590 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.220523 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" event={"ID":"f9f53575-b3b2-45d9-ad12-d79e35ed1283","Type":"ContainerStarted","Data":"6f3ad556244b13399f8e5851572c5a55dc8edff3c331b522977e19dd470bf3cd"} Jun 16 19:49:00.222271 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.222149 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hxjx5" event={"ID":"33adf1cd-f0af-48f7-97f0-7b56d140e065","Type":"ContainerStarted","Data":"83222517e571f2a0abfb3d7f3deb5ea734d750a8b91f004ba4e0deb1922b0f1d"} Jun 16 19:49:00.223818 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.223794 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" event={"ID":"d18263e1-e465-4399-bb1d-81d162d3f17b","Type":"ContainerStarted","Data":"841c30a2cfccc8917bd7790968abf279c74903adb49bd7a0b92a0d7e8ad96296"} Jun 16 19:49:00.226956 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.226938 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:49:00.227375 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227351 2550 generic.go:356] "Generic (PLEG): container finished" podID="dfc5e889-c0a5-4b6f-b6fb-242a999f1f64" containerID="d402c9cdc9f5afc3011d55ffdd1ee4862c5bb8d2d14accfad4cf91a501bd9481" exitCode=1 Jun 16 19:49:00.227495 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227430 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"f848dde102cdceaddc71de004ccccb8113aae723abf5815828a9681ffd2a8501"} Jun 16 19:49:00.227553 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227508 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"2526b9676a17b983cfa866dd76d6b9709af302d7a9724ac207f43bef8ac7bc9d"} Jun 16 19:49:00.227553 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227549 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"54c37c7a134648d307c387e1c838d8bc9a76619a0258635509ab9da9586d4536"} Jun 16 19:49:00.227666 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227585 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"c37d32b3aca554c97f5836f4fe56d9188321244c558f3e1efe276eee9e4d8dc9"} Jun 16 19:49:00.227666 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227624 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerDied","Data":"d402c9cdc9f5afc3011d55ffdd1ee4862c5bb8d2d14accfad4cf91a501bd9481"} Jun 16 19:49:00.227766 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.227666 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"b037f9e11654fc3bb94241a093c69f3f3235828da6eb54d8674009bb81a05fea"} Jun 16 19:49:00.229006 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.228983 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zbgwm" event={"ID":"f4fab3c8-424b-4219-958f-0cdd1a58fa78","Type":"ContainerStarted","Data":"61c60eaaba6d7ab05253ef0b6dc1011d96ec18eb4d0a9d9770d6450a3678b8e4"} Jun 16 19:49:00.237185 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.237139 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hrtjn" podStartSLOduration=4.506212822 podStartE2EDuration="23.23712765s" totalImagesPullingTime="18.730914828s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:00.237051836 +0000 UTC m=+23.631044544" watchObservedRunningTime="2026-06-16 19:49:00.23712765 +0000 UTC m=+23.631120373" Jun 16 19:49:00.237635 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.237605 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-253.ec2.internal" podStartSLOduration=22.237593231 podStartE2EDuration="22.237593231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:48:42.202560749 +0000 UTC m=+5.596553456" watchObservedRunningTime="2026-06-16 19:49:00.237593231 +0000 UTC m=+23.631585961" Jun 16 19:49:00.278743 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.278685 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mq6jj" podStartSLOduration=4.538727781 podStartE2EDuration="23.278663619s" totalImagesPullingTime="18.739935838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:00.277430453 +0000 UTC m=+23.671423169" watchObservedRunningTime="2026-06-16 19:49:00.278663619 +0000 UTC m=+23.672656328" Jun 16 19:49:00.336669 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.336623 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hxjx5" podStartSLOduration=4.606462025 podStartE2EDuration="23.336606934s" totalImagesPullingTime="18.730144909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:00.333898357 +0000 UTC m=+23.727891093" watchObservedRunningTime="2026-06-16 19:49:00.336606934 +0000 UTC m=+23.730599637" Jun 16 19:49:00.361660 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.361614 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7d67j" podStartSLOduration=4.639353399 podStartE2EDuration="23.361597865s" totalImagesPullingTime="18.722244466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:00.361171128 +0000 UTC m=+23.755163847" watchObservedRunningTime="2026-06-16 19:49:00.361597865 +0000 UTC m=+23.755590567" Jun 16 19:49:00.386540 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.386484 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zbgwm" podStartSLOduration=4.618820261 podStartE2EDuration="23.386453643s" totalImagesPullingTime="18.767633382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:00.385631185 +0000 UTC m=+23.779623890" watchObservedRunningTime="2026-06-16 19:49:00.386453643 +0000 UTC m=+23.780446349" Jun 16 19:49:00.816056 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.815907 2550 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 16 19:49:00.990383 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.990302 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:49:00.990852 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:00.990830 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:49:01.089720 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.089689 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:01.089893 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:01.089824 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:01.095006 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.094914 2550 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-16T19:49:00.816051287Z","UUID":"4427947c-8ec7-42e0-a67f-c54c8905d579","Handler":null,"Name":"","Endpoint":""} Jun 16 19:49:01.096672 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.096648 2550 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 16 19:49:01.096765 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.096695 2550 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 16 19:49:01.233699 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.233640 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" event={"ID":"d18263e1-e465-4399-bb1d-81d162d3f17b","Type":"ContainerStarted","Data":"cc695362ba7650441ce046a3a715f32b377984cb8eee68d1ac9d995c92779c1d"} Jun 16 19:49:01.235266 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.235236 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cnpk9" event={"ID":"10b5865c-03c2-4bfd-8edc-90a066695347","Type":"ContainerStarted","Data":"4c0c81be26c23cd1125e3298463b4333200928898d4dc72ae3305a827beaddb9"} Jun 16 19:49:01.236176 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.236157 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:49:01.236606 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.236589 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hxjx5" Jun 16 19:49:01.285211 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:01.285117 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cnpk9" podStartSLOduration=5.584058748 podStartE2EDuration="24.285100418s" totalImagesPullingTime="18.70104167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:01.257847696 +0000 UTC m=+24.651840402" watchObservedRunningTime="2026-06-16 19:49:01.285100418 +0000 UTC m=+24.679093124" Jun 16 19:49:02.089121 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:02.089037 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:02.089279 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:02.089171 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:02.089279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:02.089185 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:02.089381 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:02.089289 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:02.240604 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:02.240564 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" event={"ID":"d18263e1-e465-4399-bb1d-81d162d3f17b","Type":"ContainerStarted","Data":"02292d3e08a994e8a683db9ac275456603aa1447e567ca78a6105a72829cf7a3"} Jun 16 19:49:02.247946 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:02.247511 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:49:02.248383 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:02.248352 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"a7e26295c0e6bbf9d24d68cdb3ef42a20681511073cee6199711aa36fbfd54dd"} Jun 16 19:49:03.089118 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:03.089082 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:03.089298 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:03.089206 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:04.089116 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:04.089081 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:04.089760 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:04.089095 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:04.089760 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:04.089219 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:04.089760 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:04.089257 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:05.089426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.089240 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:05.089900 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:05.089527 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:05.258006 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.257978 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:49:05.258387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.258363 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"d0439a56a9461be7fa5706e58122e08ffcf7c4df56235e6edc3fe543582a7cfa"} Jun 16 19:49:05.258609 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.258591 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:05.258768 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.258745 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:05.258874 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.258787 2550 scope.go:117] "RemoveContainer" containerID="d402c9cdc9f5afc3011d55ffdd1ee4862c5bb8d2d14accfad4cf91a501bd9481" Jun 16 19:49:05.258874 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.258800 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:05.260570 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.260545 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="53e96cd17a487d5e86d129d234c9b4a109164a6abff3f423db8de992c40de20d" exitCode=0 Jun 16 19:49:05.260655 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.260589 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"53e96cd17a487d5e86d129d234c9b4a109164a6abff3f423db8de992c40de20d"} Jun 16 19:49:05.275749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.275725 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:05.279101 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.276852 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:05.289947 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:05.289909 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-q2xwm" podStartSLOduration=7.046240932 podStartE2EDuration="28.289896627s" totalImagesPullingTime="21.243655695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:02.271977552 +0000 UTC m=+25.665970261" watchObservedRunningTime="2026-06-16 19:49:05.289896627 +0000 UTC m=+28.683889332" Jun 16 19:49:06.089703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.089524 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:06.090043 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.089555 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:06.090043 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:06.089791 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:06.090043 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:06.089842 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:06.265650 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.265554 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="8a767e02ecec7652aa45f2ed3c4c55fde2c3d3c1fa7f0ec6320984b7ce165268" exitCode=0 Jun 16 19:49:06.265650 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.265637 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"8a767e02ecec7652aa45f2ed3c4c55fde2c3d3c1fa7f0ec6320984b7ce165268"} Jun 16 19:49:06.269690 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.269673 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:49:06.270035 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.270010 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" event={"ID":"dfc5e889-c0a5-4b6f-b6fb-242a999f1f64","Type":"ContainerStarted","Data":"f1910baeed7a713fde6b2d3f5bea9d87ad3f3ef8a618f228b00d18ab6f1a6d50"} Jun 16 19:49:06.347521 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.346507 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" podStartSLOduration=10.550698437 podStartE2EDuration="29.346462175s" totalImagesPullingTime="18.795763738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:06.342705841 +0000 UTC m=+29.736698573" watchObservedRunningTime="2026-06-16 19:49:06.346462175 +0000 UTC m=+29.740454882" Jun 16 19:49:06.810286 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.810250 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lbx28"] Jun 16 19:49:06.810493 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.810402 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:06.810547 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:06.810526 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:06.814655 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.814632 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lh5r9"] Jun 16 19:49:06.814775 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.814734 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:06.814842 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:06.814826 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:06.819120 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.819098 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq5j"] Jun 16 19:49:06.819202 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:06.819185 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:06.819273 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:06.819254 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:07.275000 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:07.274970 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="06b4ed75b0bdd61919df59d7fddfe3bb0dcbfbdd7f818c5ad21148863a4a45ac" exitCode=0 Jun 16 19:49:07.275464 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:07.275057 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"06b4ed75b0bdd61919df59d7fddfe3bb0dcbfbdd7f818c5ad21148863a4a45ac"} Jun 16 19:49:08.089351 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:08.089318 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:08.089535 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:08.089369 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:08.089535 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:08.089456 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:08.089626 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:08.089586 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:09.089871 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:09.089781 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:09.090704 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:09.089911 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:10.089173 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:10.089141 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:10.089373 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:10.089141 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:10.089373 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.089261 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-lbx28" podUID="14609d38-5cf6-4c6f-be87-f29cc29ac4e7" Jun 16 19:49:10.089373 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.089358 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lh5r9" podUID="12e4ef9d-c15d-4dff-85f5-00c7e7388fc8" Jun 16 19:49:10.895981 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:10.895945 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:10.895992 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:10.896024 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896117 2550 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896144 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896161 2550 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896173 2550 projected.go:196] Error preparing data for projected volume kube-api-access-lvxc5 for pod openshift-network-diagnostics/network-check-target-9xq5j: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896190 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret podName:14609d38-5cf6-4c6f-be87-f29cc29ac4e7 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:42.896174864 +0000 UTC m=+66.290167548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret") pod "global-pull-secret-syncer-lbx28" (UID: "14609d38-5cf6-4c6f-be87-f29cc29ac4e7") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896117 2550 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896219 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5 podName:07b1cdec-a31e-4f6b-b41e-e16e6c0cc073 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:42.896205792 +0000 UTC m=+66.290198497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lvxc5" (UniqueName: "kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5") pod "network-check-target-9xq5j" (UID: "07b1cdec-a31e-4f6b-b41e-e16e6c0cc073") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.896503 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:10.896268 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs podName:12e4ef9d-c15d-4dff-85f5-00c7e7388fc8 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:42.896255727 +0000 UTC m=+66.290248425 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs") pod "network-metrics-daemon-lh5r9" (UID: "12e4ef9d-c15d-4dff-85f5-00c7e7388fc8") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:11.089837 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:11.089802 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:11.090059 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:11.089942 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9xq5j" podUID="07b1cdec-a31e-4f6b-b41e-e16e6c0cc073" Jun 16 19:49:11.943027 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:11.942849 2550 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-253.ec2.internal" event="NodeReady" Jun 16 19:49:11.943423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:11.943138 2550 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 16 19:49:12.004268 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.004232 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:49:12.019689 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.019666 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.022349 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.022322 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dm8ww\"" Jun 16 19:49:12.022500 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.022388 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 16 19:49:12.023967 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.023945 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 16 19:49:12.024373 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.024355 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 16 19:49:12.028728 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.028399 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zr5jp"] Jun 16 19:49:12.030360 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.030341 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 16 19:49:12.047743 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.047720 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:49:12.047839 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.047753 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2zm"] Jun 16 19:49:12.047877 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.047836 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.051938 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.051908 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 16 19:49:12.051938 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.051911 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 16 19:49:12.052081 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.052066 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9jnd\"" Jun 16 19:49:12.073725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.073637 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zr5jp"] Jun 16 19:49:12.073725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.073697 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2zm"] Jun 16 19:49:12.073899 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.073751 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.076982 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.076947 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 16 19:49:12.077084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.077035 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 16 19:49:12.077084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.077048 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dg7s6\"" Jun 16 19:49:12.077292 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.077279 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 16 19:49:12.089365 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.089344 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:12.089509 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.089494 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:12.091865 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.091841 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:49:12.091968 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.091923 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:49:12.091968 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.091960 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:49:12.207037 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207004 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207037 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207041 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7chnx\" (UniqueName: \"kubernetes.io/projected/2f8f80fc-7079-472c-83de-9de737fd0b4a-kube-api-access-7chnx\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207116 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207148 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71bce5d7-8b94-4548-89c1-4b8fd80928d3-cert\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207193 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207213 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207228 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.207508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207368 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207394 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfj47\" (UniqueName: \"kubernetes.io/projected/71bce5d7-8b94-4548-89c1-4b8fd80928d3-kube-api-access-kfj47\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.207508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207418 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207439 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8f80fc-7079-472c-83de-9de737fd0b4a-tmp-dir\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.207508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207497 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmzl9\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.207682 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.207519 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8f80fc-7079-472c-83de-9de737fd0b4a-config-volume\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.292584 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.292552 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="78febe577dfee1a18a5de2f468bf0ab1b9fe33bddb69e37a6d43f47a64c8b024" exitCode=0 Jun 16 19:49:12.292725 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.292608 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"78febe577dfee1a18a5de2f468bf0ab1b9fe33bddb69e37a6d43f47a64c8b024"} Jun 16 19:49:12.308313 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308289 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.308419 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308320 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.308419 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308337 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.308584 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.308564 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:12.308640 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308590 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.308693 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.308667 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:12.808623095 +0000 UTC m=+36.202615797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:12.308751 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308700 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfj47\" (UniqueName: \"kubernetes.io/projected/71bce5d7-8b94-4548-89c1-4b8fd80928d3-kube-api-access-kfj47\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.308806 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308746 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.308806 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308782 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8f80fc-7079-472c-83de-9de737fd0b4a-tmp-dir\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.308913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308854 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmzl9\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.308913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308893 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8f80fc-7079-472c-83de-9de737fd0b4a-config-volume\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.309028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308964 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.309028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308969 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.309028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.308989 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7chnx\" (UniqueName: \"kubernetes.io/projected/2f8f80fc-7079-472c-83de-9de737fd0b4a-kube-api-access-7chnx\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.309028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309017 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.309227 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309041 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.309227 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309070 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71bce5d7-8b94-4548-89c1-4b8fd80928d3-cert\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.309227 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309136 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f8f80fc-7079-472c-83de-9de737fd0b4a-tmp-dir\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.309227 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.309218 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:12.309227 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.309230 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:12.309454 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.309276 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:12.809259887 +0000 UTC m=+36.203252575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:12.309561 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309536 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2f8f80fc-7079-472c-83de-9de737fd0b4a-config-volume\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.309622 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309558 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.309931 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.309908 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.312552 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.312533 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.312645 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.312559 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.312685 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.312667 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71bce5d7-8b94-4548-89c1-4b8fd80928d3-cert\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.327786 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.327724 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.328068 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.328038 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmzl9\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.328145 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.328038 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfj47\" (UniqueName: \"kubernetes.io/projected/71bce5d7-8b94-4548-89c1-4b8fd80928d3-kube-api-access-kfj47\") pod \"ingress-canary-6d2zm\" (UID: \"71bce5d7-8b94-4548-89c1-4b8fd80928d3\") " pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.328288 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.328269 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7chnx\" (UniqueName: \"kubernetes.io/projected/2f8f80fc-7079-472c-83de-9de737fd0b4a-kube-api-access-7chnx\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.382164 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.382136 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6d2zm" Jun 16 19:49:12.604361 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.604286 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6d2zm"] Jun 16 19:49:12.609258 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:12.609232 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71bce5d7_8b94_4548_89c1_4b8fd80928d3.slice/crio-59900d65e8b8e51b5a6a981db9ea54db0594076253c413d0afc94661ea38b268 WatchSource:0}: Error finding container 59900d65e8b8e51b5a6a981db9ea54db0594076253c413d0afc94661ea38b268: Status 404 returned error can't find the container with id 59900d65e8b8e51b5a6a981db9ea54db0594076253c413d0afc94661ea38b268 Jun 16 19:49:12.812328 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.812292 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:12.812557 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:12.812343 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:12.812557 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.812451 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:12.812557 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.812540 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:13.812521757 +0000 UTC m=+37.206514441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:12.812665 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.812457 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:12.812665 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.812569 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:12.812665 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:12.812609 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:13.812598656 +0000 UTC m=+37.206591340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:13.089374 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.089343 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:13.091994 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.091926 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 16 19:49:13.092126 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.092010 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 16 19:49:13.092126 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.092035 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:49:13.299559 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.299529 2550 generic.go:356] "Generic (PLEG): container finished" podID="35b195fc-bc90-4305-ab88-5ecd049fb77e" containerID="221f42cb7342d5e06fdbc729b5199546004fc71d859189315d0300116d85ff46" exitCode=0 Jun 16 19:49:13.299715 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.299609 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerDied","Data":"221f42cb7342d5e06fdbc729b5199546004fc71d859189315d0300116d85ff46"} Jun 16 19:49:13.300958 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.300931 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d2zm" event={"ID":"71bce5d7-8b94-4548-89c1-4b8fd80928d3","Type":"ContainerStarted","Data":"59900d65e8b8e51b5a6a981db9ea54db0594076253c413d0afc94661ea38b268"} Jun 16 19:49:13.821536 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.821310 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:13.821731 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:13.821583 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:13.821731 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:13.821486 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:13.821731 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:13.821681 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.821659001 +0000 UTC m=+39.215651698 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:13.821888 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:13.821741 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:13.821888 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:13.821756 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:13.821888 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:13.821808 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.821793451 +0000 UTC m=+39.215786151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:14.306337 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.306304 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5775w" event={"ID":"35b195fc-bc90-4305-ab88-5ecd049fb77e","Type":"ContainerStarted","Data":"bff9bea1e316be1bb28aad02d399ea619c4e37f06aaf68ae0ee51dee80b77963"} Jun 16 19:49:14.330610 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.330562 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5775w" podStartSLOduration=8.702026776 podStartE2EDuration="37.330544458s" totalImagesPullingTime="28.628517682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:14.330444997 +0000 UTC m=+37.724437702" watchObservedRunningTime="2026-06-16 19:49:14.330544458 +0000 UTC m=+37.724537164" Jun 16 19:49:14.425454 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.425410 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7"] Jun 16 19:49:14.449953 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.449920 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7"] Jun 16 19:49:14.450127 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.450036 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.452754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.452729 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.453189 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.453162 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 16 19:49:14.454147 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.454122 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.455423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.454970 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vqtn8\"" Jun 16 19:49:14.455423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.455277 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 16 19:49:14.480540 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.480493 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:14.537650 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.537619 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp"] Jun 16 19:49:14.559183 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.559098 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp"] Jun 16 19:49:14.559327 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.559220 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" Jun 16 19:49:14.562622 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.562594 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.562849 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.562814 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-dhsg8\"" Jun 16 19:49:14.563015 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.562824 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.584601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.584569 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:14.627757 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.627713 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.627946 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.627786 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxq4h\" (UniqueName: \"kubernetes.io/projected/b7c6e32c-259e-4921-9914-474327435dd2-kube-api-access-mxq4h\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.627946 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.627822 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7c6e32c-259e-4921-9914-474327435dd2-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.665005 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.664969 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-r6tp8"] Jun 16 19:49:14.681247 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.681204 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44"] Jun 16 19:49:14.681406 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.681345 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.686687 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.686659 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 16 19:49:14.686687 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.686659 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-8fj7d\"" Jun 16 19:49:14.686937 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.686924 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 16 19:49:14.687645 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.687624 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.688391 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.688249 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.695205 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.695181 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gcgjh"] Jun 16 19:49:14.695326 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.695308 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.698788 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.698668 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 16 19:49:14.703920 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.703568 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ggsd2\"" Jun 16 19:49:14.704163 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.703923 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 16 19:49:14.704235 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.704161 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.704544 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.704523 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.717311 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.717286 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7cf7bff7c4-t7mkh"] Jun 16 19:49:14.717452 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.717433 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.720967 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.720938 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jun 16 19:49:14.720967 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.720968 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.721325 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.721305 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.721412 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.721355 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jun 16 19:49:14.721524 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.721508 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-86xb7\"" Jun 16 19:49:14.727225 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.727208 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jun 16 19:49:14.728228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.728204 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.728296 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.728272 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqg4f\" (UniqueName: \"kubernetes.io/projected/1afd746c-550b-4ba8-8763-855f76499ec9-kube-api-access-vqg4f\") pod \"volume-data-source-validator-bd4ccd799-v9mzp\" (UID: \"1afd746c-550b-4ba8-8763-855f76499ec9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" Jun 16 19:49:14.728356 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.728314 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxq4h\" (UniqueName: \"kubernetes.io/projected/b7c6e32c-259e-4921-9914-474327435dd2-kube-api-access-mxq4h\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.728408 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:14.728358 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:14.728408 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.728359 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7c6e32c-259e-4921-9914-474327435dd2-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.728531 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:14.728423 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.228401493 +0000 UTC m=+38.622394183 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:14.729148 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.729129 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/b7c6e32c-259e-4921-9914-474327435dd2-telemetry-config\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.737518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.737498 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gcgjh"] Jun 16 19:49:14.737601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.737536 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-r6tp8"] Jun 16 19:49:14.737601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.737553 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44"] Jun 16 19:49:14.737601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.737571 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cf7bff7c4-t7mkh"] Jun 16 19:49:14.737717 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.737649 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.747866 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.747845 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 16 19:49:14.747963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.747880 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 16 19:49:14.747963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.747919 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 16 19:49:14.747963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.747936 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.748346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.748321 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 16 19:49:14.748542 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.748371 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.748542 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.748437 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t5ws9\"" Jun 16 19:49:14.753052 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.753031 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxq4h\" (UniqueName: \"kubernetes.io/projected/b7c6e32c-259e-4921-9914-474327435dd2-kube-api-access-mxq4h\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:14.763930 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.763871 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh"] Jun 16 19:49:14.787699 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.787618 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm"] Jun 16 19:49:14.787833 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.787745 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:14.797104 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.797082 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 16 19:49:14.797228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.797207 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 16 19:49:14.797298 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.797254 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-zcrkw\"" Jun 16 19:49:14.797298 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.797286 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.799569 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.799550 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.803588 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.803570 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm"] Jun 16 19:49:14.803672 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.803601 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh"] Jun 16 19:49:14.803672 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.803651 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:14.809697 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.809608 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:14.809697 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.809668 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 16 19:49:14.809880 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.809718 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 16 19:49:14.809880 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.809660 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:14.810055 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.810033 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xtgqc\"" Jun 16 19:49:14.828993 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.828969 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6smlr\" (UniqueName: \"kubernetes.io/projected/8a2d9f6f-ac73-4b77-80b7-af46215799ca-kube-api-access-6smlr\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.829120 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829006 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-snapshots\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.829120 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829032 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsxq4\" (UniqueName: \"kubernetes.io/projected/b4d1a074-0521-41f3-9470-6fd3e560d427-kube-api-access-vsxq4\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.829243 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829133 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2d9f6f-ac73-4b77-80b7-af46215799ca-serving-cert\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.829243 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829172 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.829243 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829206 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.829368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829287 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43555df0-5adb-46e0-a640-96da6ecbed9b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.829368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829327 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlb5r\" (UniqueName: \"kubernetes.io/projected/43555df0-5adb-46e0-a640-96da6ecbed9b-kube-api-access-vlb5r\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.829458 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829402 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqg4f\" (UniqueName: \"kubernetes.io/projected/1afd746c-550b-4ba8-8763-855f76499ec9-kube-api-access-vqg4f\") pod \"volume-data-source-validator-bd4ccd799-v9mzp\" (UID: \"1afd746c-550b-4ba8-8763-855f76499ec9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" Jun 16 19:49:14.829458 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829430 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-trusted-ca\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.829458 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829454 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.829621 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829512 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-config\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.829621 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.829535 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-tmp\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.845245 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.845212 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqg4f\" (UniqueName: \"kubernetes.io/projected/1afd746c-550b-4ba8-8763-855f76499ec9-kube-api-access-vqg4f\") pod \"volume-data-source-validator-bd4ccd799-v9mzp\" (UID: \"1afd746c-550b-4ba8-8763-855f76499ec9\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" Jun 16 19:49:14.861183 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.861144 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:14.869669 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.869640 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" Jun 16 19:49:14.930859 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.930828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43555df0-5adb-46e0-a640-96da6ecbed9b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.930868 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlb5r\" (UniqueName: \"kubernetes.io/projected/43555df0-5adb-46e0-a640-96da6ecbed9b-kube-api-access-vlb5r\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.930988 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-trusted-ca\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.931030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931025 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931047 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-config\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931072 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-tmp\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931102 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2f94-84e7-493b-a31b-2ab77c1c570f-config\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931130 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931156 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw99f\" (UniqueName: \"kubernetes.io/projected/f6c2fbf0-8de6-4906-81dc-6c305e610109-kube-api-access-jw99f\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:14.931226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931204 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6smlr\" (UniqueName: \"kubernetes.io/projected/8a2d9f6f-ac73-4b77-80b7-af46215799ca-kube-api-access-6smlr\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.931535 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931233 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-snapshots\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931535 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931279 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsxq4\" (UniqueName: \"kubernetes.io/projected/b4d1a074-0521-41f3-9470-6fd3e560d427-kube-api-access-vsxq4\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.931670 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931538 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c2fbf0-8de6-4906-81dc-6c305e610109-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:14.931670 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931620 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.931670 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931664 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-989t5\" (UniqueName: \"kubernetes.io/projected/ae217bed-f919-49eb-abb3-6d80b44c7486-kube-api-access-989t5\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931684 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-service-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931694 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2f94-84e7-493b-a31b-2ab77c1c570f-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931722 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2d9f6f-ac73-4b77-80b7-af46215799ca-serving-cert\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931730 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-tmp\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931756 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c2fbf0-8de6-4906-81dc-6c305e610109-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931779 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-config\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.931800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931784 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931841 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931869 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll75f\" (UniqueName: \"kubernetes.io/projected/e61b2f94-84e7-493b-a31b-2ab77c1c570f-kube-api-access-ll75f\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931895 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-default-certificate\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:14.931909 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931966 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-stats-auth\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.931993 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/43555df0-5adb-46e0-a640-96da6ecbed9b-snapshots\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.932138 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:14.932049 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls podName:b4d1a074-0521-41f3-9470-6fd3e560d427 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.432022759 +0000 UTC m=+38.826015445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vrx44" (UID: "b4d1a074-0521-41f3-9470-6fd3e560d427") : secret "samples-operator-tls" not found Jun 16 19:49:14.932387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.932148 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a2d9f6f-ac73-4b77-80b7-af46215799ca-trusted-ca\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.932565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.932543 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/43555df0-5adb-46e0-a640-96da6ecbed9b-trusted-ca-bundle\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.933559 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.933538 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43555df0-5adb-46e0-a640-96da6ecbed9b-serving-cert\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.933872 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.933857 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a2d9f6f-ac73-4b77-80b7-af46215799ca-serving-cert\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.956719 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.956692 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlb5r\" (UniqueName: \"kubernetes.io/projected/43555df0-5adb-46e0-a640-96da6ecbed9b-kube-api-access-vlb5r\") pod \"insights-operator-5bbd86d6bd-gcgjh\" (UID: \"43555df0-5adb-46e0-a640-96da6ecbed9b\") " pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:14.957127 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.957109 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsxq4\" (UniqueName: \"kubernetes.io/projected/b4d1a074-0521-41f3-9470-6fd3e560d427-kube-api-access-vsxq4\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:14.958133 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.958111 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6smlr\" (UniqueName: \"kubernetes.io/projected/8a2d9f6f-ac73-4b77-80b7-af46215799ca-kube-api-access-6smlr\") pod \"console-operator-5dbbb5d744-r6tp8\" (UID: \"8a2d9f6f-ac73-4b77-80b7-af46215799ca\") " pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:14.993093 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:14.993064 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:15.027520 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.027359 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032422 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-989t5\" (UniqueName: \"kubernetes.io/projected/ae217bed-f919-49eb-abb3-6d80b44c7486-kube-api-access-989t5\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032501 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2f94-84e7-493b-a31b-2ab77c1c570f-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032535 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c2fbf0-8de6-4906-81dc-6c305e610109-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032585 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll75f\" (UniqueName: \"kubernetes.io/projected/e61b2f94-84e7-493b-a31b-2ab77c1c570f-kube-api-access-ll75f\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032613 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-default-certificate\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032670 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-stats-auth\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.032759 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2f94-84e7-493b-a31b-2ab77c1c570f-config\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.033952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.033355 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e61b2f94-84e7-493b-a31b-2ab77c1c570f-config\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.034253 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f6c2fbf0-8de6-4906-81dc-6c305e610109-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.034301 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.034331 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw99f\" (UniqueName: \"kubernetes.io/projected/f6c2fbf0-8de6-4906-81dc-6c305e610109-kube-api-access-jw99f\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.034383 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c2fbf0-8de6-4906-81dc-6c305e610109-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.034403 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:15.034423 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.034419 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.034738 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.034457 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.534441152 +0000 UTC m=+38.928433837 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:15.034738 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.034546 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:15.534534438 +0000 UTC m=+38.928527139 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:15.037314 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.037266 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f6c2fbf0-8de6-4906-81dc-6c305e610109-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.037411 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.037366 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e61b2f94-84e7-493b-a31b-2ab77c1c570f-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.037642 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.037621 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-stats-auth\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.038103 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.038084 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-default-certificate\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.044332 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.044287 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll75f\" (UniqueName: \"kubernetes.io/projected/e61b2f94-84e7-493b-a31b-2ab77c1c570f-kube-api-access-ll75f\") pod \"service-ca-operator-7ccbfd59dc-79mmm\" (UID: \"e61b2f94-84e7-493b-a31b-2ab77c1c570f\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.054295 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.054271 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw99f\" (UniqueName: \"kubernetes.io/projected/f6c2fbf0-8de6-4906-81dc-6c305e610109-kube-api-access-jw99f\") pod \"kube-storage-version-migrator-operator-7c578b78fc-lzswh\" (UID: \"f6c2fbf0-8de6-4906-81dc-6c305e610109\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.072104 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.072024 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-989t5\" (UniqueName: \"kubernetes.io/projected/ae217bed-f919-49eb-abb3-6d80b44c7486-kube-api-access-989t5\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.098675 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.098631 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" Jun 16 19:49:15.113802 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.113714 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" Jun 16 19:49:15.118987 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.118909 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp"] Jun 16 19:49:15.151178 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.151144 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:15.159639 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.159615 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-5dbbb5d744-r6tp8"] Jun 16 19:49:15.162715 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:15.162681 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2d9f6f_ac73_4b77_80b7_af46215799ca.slice/crio-d8fb1202bf205c1bc3ea7d2d6425d49805b55dc49e7f7dc33a4a8649a22f27db WatchSource:0}: Error finding container d8fb1202bf205c1bc3ea7d2d6425d49805b55dc49e7f7dc33a4a8649a22f27db: Status 404 returned error can't find the container with id d8fb1202bf205c1bc3ea7d2d6425d49805b55dc49e7f7dc33a4a8649a22f27db Jun 16 19:49:15.209197 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.206763 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5bbd86d6bd-gcgjh"] Jun 16 19:49:15.221759 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.221715 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:15.236018 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.235983 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:15.236166 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.236144 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:15.236240 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.236228 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:16.236207337 +0000 UTC m=+39.630200026 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:15.263414 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.263385 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh"] Jun 16 19:49:15.288630 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.288604 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm"] Jun 16 19:49:15.309378 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.309347 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" event={"ID":"8a2d9f6f-ac73-4b77-80b7-af46215799ca","Type":"ContainerStarted","Data":"d8fb1202bf205c1bc3ea7d2d6425d49805b55dc49e7f7dc33a4a8649a22f27db"} Jun 16 19:49:15.310426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.310406 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" event={"ID":"1afd746c-550b-4ba8-8763-855f76499ec9","Type":"ContainerStarted","Data":"bacf1ce8dadcc6eeed66d032e50ce81764bd7c0b0494c54e5309713b7b0ce5dc"} Jun 16 19:49:15.314011 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:15.313983 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43555df0_5adb_46e0_a640_96da6ecbed9b.slice/crio-8dec33b5c79e526d5c3597459119a304dc369a3c140a237b6ae1a4ac2f8769a7 WatchSource:0}: Error finding container 8dec33b5c79e526d5c3597459119a304dc369a3c140a237b6ae1a4ac2f8769a7: Status 404 returned error can't find the container with id 8dec33b5c79e526d5c3597459119a304dc369a3c140a237b6ae1a4ac2f8769a7 Jun 16 19:49:15.314773 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:15.314722 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6c2fbf0_8de6_4906_81dc_6c305e610109.slice/crio-a2a8dbdc02fd78bbad4748f6820bad7a7f87268b13cfd78d7d9f97b5da604094 WatchSource:0}: Error finding container a2a8dbdc02fd78bbad4748f6820bad7a7f87268b13cfd78d7d9f97b5da604094: Status 404 returned error can't find the container with id a2a8dbdc02fd78bbad4748f6820bad7a7f87268b13cfd78d7d9f97b5da604094 Jun 16 19:49:15.315291 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:15.315269 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61b2f94_84e7_493b_a31b_2ab77c1c570f.slice/crio-62607c7f55edc1a9efb24a582094aef075eb7788cc3e526b3417a9cf6dce1761 WatchSource:0}: Error finding container 62607c7f55edc1a9efb24a582094aef075eb7788cc3e526b3417a9cf6dce1761: Status 404 returned error can't find the container with id 62607c7f55edc1a9efb24a582094aef075eb7788cc3e526b3417a9cf6dce1761 Jun 16 19:49:15.437591 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.437565 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:15.437692 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.437680 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 16 19:49:15.437737 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.437728 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls podName:b4d1a074-0521-41f3-9470-6fd3e560d427 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:16.43771473 +0000 UTC m=+39.831707414 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vrx44" (UID: "b4d1a074-0521-41f3-9470-6fd3e560d427") : secret "samples-operator-tls" not found Jun 16 19:49:15.538387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.538346 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.538568 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.538409 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:15.538568 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.538454 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:15.538568 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.538543 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:16.538525866 +0000 UTC m=+39.932518553 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:15.538568 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.538558 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:16.538551779 +0000 UTC m=+39.932544463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:15.840555 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.840513 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:15.840750 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:15.840580 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:15.840750 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.840685 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:15.840870 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.840743 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:15.840870 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.840756 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:19.840740252 +0000 UTC m=+43.234732935 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:15.840870 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.840761 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:15.840870 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:15.840801 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:19.84078924 +0000 UTC m=+43.234781924 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:16.246063 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.246020 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:16.246244 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.246197 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:16.246321 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.246277 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:18.246255598 +0000 UTC m=+41.640248289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:16.316149 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.316108 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6d2zm" event={"ID":"71bce5d7-8b94-4548-89c1-4b8fd80928d3","Type":"ContainerStarted","Data":"a22c6859217a29eaf9d18a7ac2d74f50a5863cfd3a2aa174e1b9814e5811a700"} Jun 16 19:49:16.320705 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.320616 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" event={"ID":"e61b2f94-84e7-493b-a31b-2ab77c1c570f","Type":"ContainerStarted","Data":"62607c7f55edc1a9efb24a582094aef075eb7788cc3e526b3417a9cf6dce1761"} Jun 16 19:49:16.322417 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.322359 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" event={"ID":"f6c2fbf0-8de6-4906-81dc-6c305e610109","Type":"ContainerStarted","Data":"a2a8dbdc02fd78bbad4748f6820bad7a7f87268b13cfd78d7d9f97b5da604094"} Jun 16 19:49:16.324438 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.324410 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" event={"ID":"43555df0-5adb-46e0-a640-96da6ecbed9b","Type":"ContainerStarted","Data":"8dec33b5c79e526d5c3597459119a304dc369a3c140a237b6ae1a4ac2f8769a7"} Jun 16 19:49:16.337918 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.337178 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6d2zm" podStartSLOduration=1.6176502720000001 podStartE2EDuration="4.337155548s" totalImagesPullingTime="2.719505276s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:16.335959536 +0000 UTC m=+39.729952245" watchObservedRunningTime="2026-06-16 19:49:16.337155548 +0000 UTC m=+39.731148256" Jun 16 19:49:16.448404 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.448275 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:16.448588 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.448419 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 16 19:49:16.448588 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.448507 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls podName:b4d1a074-0521-41f3-9470-6fd3e560d427 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:18.44848066 +0000 UTC m=+41.842473359 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vrx44" (UID: "b4d1a074-0521-41f3-9470-6fd3e560d427") : secret "samples-operator-tls" not found Jun 16 19:49:16.548984 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.548879 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:16.549764 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.549312 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:16.549764 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:16.549420 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:16.549764 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.549639 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:18.549620232 +0000 UTC m=+41.943612922 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:16.549764 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:16.549732 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:18.549719955 +0000 UTC m=+41.943712648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:17.940903 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:17.940692 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:18.042958 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:18.042926 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:18.266359 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:18.266274 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:18.266512 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.266442 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:18.266576 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.266533 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.266515033 +0000 UTC m=+45.660507721 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:18.468203 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:18.468136 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:18.468393 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.468270 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 16 19:49:18.468393 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.468351 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls podName:b4d1a074-0521-41f3-9470-6fd3e560d427 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.468329902 +0000 UTC m=+45.862322591 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vrx44" (UID: "b4d1a074-0521-41f3-9470-6fd3e560d427") : secret "samples-operator-tls" not found Jun 16 19:49:18.568827 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:18.568740 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:18.568987 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:18.568885 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:18.568987 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.568917 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.568893715 +0000 UTC m=+45.962886417 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:18.568987 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.568966 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:18.569117 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:18.569008 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.568997261 +0000 UTC m=+45.962989945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:19.879642 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:19.879601 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:19.879666 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:19.879761 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:19.879779 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:19.879835 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:27.879815583 +0000 UTC m=+51.273808348 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:19.879759 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:19.880069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:19.879901 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:27.879887603 +0000 UTC m=+51.273880288 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:21.338669 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.338630 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" event={"ID":"43555df0-5adb-46e0-a640-96da6ecbed9b","Type":"ContainerStarted","Data":"96f43a90b8f8ca025659213216e9c8fbce35369a9eb23b89c34515e549dbc257"} Jun 16 19:49:21.340414 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.340392 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/0.log" Jun 16 19:49:21.340567 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.340433 2550 generic.go:356] "Generic (PLEG): container finished" podID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" containerID="29c53b06e7bada71d31ff81d106f5bb443212e9f7985ccfb2186c73b0a075900" exitCode=255 Jun 16 19:49:21.340567 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.340466 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" event={"ID":"8a2d9f6f-ac73-4b77-80b7-af46215799ca","Type":"ContainerDied","Data":"29c53b06e7bada71d31ff81d106f5bb443212e9f7985ccfb2186c73b0a075900"} Jun 16 19:49:21.340772 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.340756 2550 scope.go:117] "RemoveContainer" containerID="29c53b06e7bada71d31ff81d106f5bb443212e9f7985ccfb2186c73b0a075900" Jun 16 19:49:21.342100 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.342074 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" event={"ID":"1afd746c-550b-4ba8-8763-855f76499ec9","Type":"ContainerStarted","Data":"634259f325a4d6732b061f9efa72532bf734999e3e31d1f6fe5db6b5ba669efe"} Jun 16 19:49:21.343840 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.343817 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" event={"ID":"e61b2f94-84e7-493b-a31b-2ab77c1c570f","Type":"ContainerStarted","Data":"7e62fe56b7102a03d01ee906e5631b711b4698c093f3336e316a52db5267ef9e"} Jun 16 19:49:21.345301 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.345276 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" event={"ID":"f6c2fbf0-8de6-4906-81dc-6c305e610109","Type":"ContainerStarted","Data":"44e85f062c63b86ea94b2343eaf6ddeb5f5ad57653694482a478cd6ae4c239ac"} Jun 16 19:49:21.352123 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.352057 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-78dqb"] Jun 16 19:49:21.361137 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.361087 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" podStartSLOduration=2.158848194 podStartE2EDuration="7.361069469s" totalImagesPullingTime="5.202221275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:21.359865954 +0000 UTC m=+44.753858672" watchObservedRunningTime="2026-06-16 19:49:21.361069469 +0000 UTC m=+44.755062156" Jun 16 19:49:21.371768 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.371742 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-78dqb"] Jun 16 19:49:21.371907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.371850 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" Jun 16 19:49:21.374768 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.374678 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l2n94\"" Jun 16 19:49:21.383152 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.383106 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-bd4ccd799-v9mzp" podStartSLOduration=2.021016588 podStartE2EDuration="7.38309059s" totalImagesPullingTime="5.362074002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:21.382417684 +0000 UTC m=+44.776410391" watchObservedRunningTime="2026-06-16 19:49:21.38309059 +0000 UTC m=+44.777083295" Jun 16 19:49:21.394614 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.394590 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gclff\" (UniqueName: \"kubernetes.io/projected/39baf35c-b9d4-4f7c-80ae-a413754114ce-kube-api-access-gclff\") pod \"network-check-source-6947749cfc-78dqb\" (UID: \"39baf35c-b9d4-4f7c-80ae-a413754114ce\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" Jun 16 19:49:21.431938 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.431722 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" podStartSLOduration=2.224210535 podStartE2EDuration="7.431701393s" totalImagesPullingTime="5.207490858s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:21.431439518 +0000 UTC m=+44.825432225" watchObservedRunningTime="2026-06-16 19:49:21.431701393 +0000 UTC m=+44.825694100" Jun 16 19:49:21.449931 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.449879 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" podStartSLOduration=2.248471133 podStartE2EDuration="7.449860737s" totalImagesPullingTime="5.201389604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:21.449040066 +0000 UTC m=+44.843032774" watchObservedRunningTime="2026-06-16 19:49:21.449860737 +0000 UTC m=+44.843853479" Jun 16 19:49:21.496099 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.495891 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gclff\" (UniqueName: \"kubernetes.io/projected/39baf35c-b9d4-4f7c-80ae-a413754114ce-kube-api-access-gclff\") pod \"network-check-source-6947749cfc-78dqb\" (UID: \"39baf35c-b9d4-4f7c-80ae-a413754114ce\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" Jun 16 19:49:21.510133 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.510089 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gclff\" (UniqueName: \"kubernetes.io/projected/39baf35c-b9d4-4f7c-80ae-a413754114ce-kube-api-access-gclff\") pod \"network-check-source-6947749cfc-78dqb\" (UID: \"39baf35c-b9d4-4f7c-80ae-a413754114ce\") " pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" Jun 16 19:49:21.569309 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.569270 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:21.637461 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.637416 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:21.696967 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.696924 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" Jun 16 19:49:21.881735 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:21.881709 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6947749cfc-78dqb"] Jun 16 19:49:21.884544 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:21.884437 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39baf35c_b9d4_4f7c_80ae_a413754114ce.slice/crio-bbaf82bb8f6fa0eb90ec63363fc0a6c692505e73a47d6413c8c0994092e52f3b WatchSource:0}: Error finding container bbaf82bb8f6fa0eb90ec63363fc0a6c692505e73a47d6413c8c0994092e52f3b: Status 404 returned error can't find the container with id bbaf82bb8f6fa0eb90ec63363fc0a6c692505e73a47d6413c8c0994092e52f3b Jun 16 19:49:22.008144 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.008109 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kd8fl"] Jun 16 19:49:22.027650 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.027626 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.030351 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.030331 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 16 19:49:22.030682 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.030666 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 16 19:49:22.032671 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.032647 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27kct\"" Jun 16 19:49:22.042491 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.042455 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kd8fl"] Jun 16 19:49:22.062126 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.062099 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.102034 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.101999 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b7b97f2-abc7-4501-9d59-413a9ccb196f-data-volume\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.102168 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.102038 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsm7k\" (UniqueName: \"kubernetes.io/projected/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-api-access-dsm7k\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.102210 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.102185 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.102281 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.102262 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b7b97f2-abc7-4501-9d59-413a9ccb196f-crio-socket\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.102357 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.102310 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.138147 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.138066 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.203384 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203348 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203600 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203421 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b7b97f2-abc7-4501-9d59-413a9ccb196f-crio-socket\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203600 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203461 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203600 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.203521 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 16 19:49:22.203600 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203529 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b7b97f2-abc7-4501-9d59-413a9ccb196f-data-volume\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203600 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.203591 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.703571742 +0000 UTC m=+46.097564434 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : secret "insights-runtime-extractor-tls" not found Jun 16 19:49:22.203913 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.203636 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 16 19:49:22.203913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203635 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsm7k\" (UniqueName: \"kubernetes.io/projected/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-api-access-dsm7k\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203680 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8b7b97f2-abc7-4501-9d59-413a9ccb196f-crio-socket\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.203913 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.203694 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:22.703676724 +0000 UTC m=+46.097669423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : configmap "kube-rbac-proxy" not found Jun 16 19:49:22.203913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.203854 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8b7b97f2-abc7-4501-9d59-413a9ccb196f-data-volume\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.216437 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.216402 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsm7k\" (UniqueName: \"kubernetes.io/projected/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-api-access-dsm7k\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.304111 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.304078 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:22.304248 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.304230 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:22.304326 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.304315 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:30.304300718 +0000 UTC m=+53.698293405 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:22.350302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.350275 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/1.log" Jun 16 19:49:22.350772 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.350715 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/0.log" Jun 16 19:49:22.350772 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.350750 2550 generic.go:356] "Generic (PLEG): container finished" podID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" exitCode=255 Jun 16 19:49:22.350884 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.350843 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" event={"ID":"8a2d9f6f-ac73-4b77-80b7-af46215799ca","Type":"ContainerDied","Data":"32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002"} Jun 16 19:49:22.350940 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.350900 2550 scope.go:117] "RemoveContainer" containerID="29c53b06e7bada71d31ff81d106f5bb443212e9f7985ccfb2186c73b0a075900" Jun 16 19:49:22.351182 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.351144 2550 scope.go:117] "RemoveContainer" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" Jun 16 19:49:22.351354 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.351334 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:22.352304 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.352118 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" event={"ID":"39baf35c-b9d4-4f7c-80ae-a413754114ce","Type":"ContainerStarted","Data":"bbaf82bb8f6fa0eb90ec63363fc0a6c692505e73a47d6413c8c0994092e52f3b"} Jun 16 19:49:22.474144 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.474049 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.505860 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.505831 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:22.506034 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.506012 2550 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 16 19:49:22.506120 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.506107 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls podName:b4d1a074-0521-41f3-9470-6fd3e560d427 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:30.506082043 +0000 UTC m=+53.900074728 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls") pod "cluster-samples-operator-9547488fd-vrx44" (UID: "b4d1a074-0521-41f3-9470-6fd3e560d427") : secret "samples-operator-tls" not found Jun 16 19:49:22.573982 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.573884 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.606453 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.606421 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:22.606649 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.606520 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:22.606828 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.606801 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:30.606784135 +0000 UTC m=+54.000776822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:22.606828 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.606798 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:22.607042 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.606845 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:30.606834939 +0000 UTC m=+54.000827623 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:22.685219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.685124 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.702938 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.702906 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw"] Jun 16 19:49:22.707948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.707921 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.708114 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.707989 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:22.708114 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.708070 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 16 19:49:22.708228 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.708145 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:23.708125682 +0000 UTC m=+47.102118368 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : configmap "kube-rbac-proxy" not found Jun 16 19:49:22.708228 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.708080 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 16 19:49:22.708228 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:22.708225 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:23.708208141 +0000 UTC m=+47.102200840 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : secret "insights-runtime-extractor-tls" not found Jun 16 19:49:22.717933 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.717896 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" Jun 16 19:49:22.723402 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.723206 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 16 19:49:22.723613 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.723526 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:22.723770 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.723743 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-58kvv\"" Jun 16 19:49:22.724810 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.724748 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw"] Jun 16 19:49:22.764821 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.764712 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.808580 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.808540 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwv5m\" (UniqueName: \"kubernetes.io/projected/4ac29a92-177c-45dd-8eed-1b3f7ae3e948-kube-api-access-nwv5m\") pod \"migrator-d4bcd4867-r42rw\" (UID: \"4ac29a92-177c-45dd-8eed-1b3f7ae3e948\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" Jun 16 19:49:22.850172 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.850136 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:22.909935 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.909902 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwv5m\" (UniqueName: \"kubernetes.io/projected/4ac29a92-177c-45dd-8eed-1b3f7ae3e948-kube-api-access-nwv5m\") pod \"migrator-d4bcd4867-r42rw\" (UID: \"4ac29a92-177c-45dd-8eed-1b3f7ae3e948\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" Jun 16 19:49:22.922029 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.921998 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwv5m\" (UniqueName: \"kubernetes.io/projected/4ac29a92-177c-45dd-8eed-1b3f7ae3e948-kube-api-access-nwv5m\") pod \"migrator-d4bcd4867-r42rw\" (UID: \"4ac29a92-177c-45dd-8eed-1b3f7ae3e948\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" Jun 16 19:49:22.956665 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:22.956628 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:23.031205 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.031126 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" Jun 16 19:49:23.053263 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.053227 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:23.197025 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.196898 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:23.211444 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.211413 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrtjn_c0a04b50-3f53-4adb-8f5d-e417de7e35de/dns-node-resolver/0.log" Jun 16 19:49:23.225221 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.225178 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw"] Jun 16 19:49:23.231528 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:23.231496 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ac29a92_177c_45dd_8eed_1b3f7ae3e948.slice/crio-e38a475434cac19da0c41cb27fd8d3958a79bffda3cbc8261cbe5ee5ca17b127 WatchSource:0}: Error finding container e38a475434cac19da0c41cb27fd8d3958a79bffda3cbc8261cbe5ee5ca17b127: Status 404 returned error can't find the container with id e38a475434cac19da0c41cb27fd8d3958a79bffda3cbc8261cbe5ee5ca17b127 Jun 16 19:49:23.318283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.318185 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:23.358949 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.358921 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/1.log" Jun 16 19:49:23.359403 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.359326 2550 scope.go:117] "RemoveContainer" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" Jun 16 19:49:23.359617 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:23.359586 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:23.360233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.360206 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" event={"ID":"4ac29a92-177c-45dd-8eed-1b3f7ae3e948","Type":"ContainerStarted","Data":"e38a475434cac19da0c41cb27fd8d3958a79bffda3cbc8261cbe5ee5ca17b127"} Jun 16 19:49:23.600336 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.600271 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7d67j_856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3/node-ca/0.log" Jun 16 19:49:23.720162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.720119 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:23.720321 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:23.720214 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:23.720321 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:23.720279 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 16 19:49:23.720407 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:23.720337 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:25.72032216 +0000 UTC m=+49.114314847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : secret "insights-runtime-extractor-tls" not found Jun 16 19:49:23.720407 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:23.720336 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 16 19:49:23.720407 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:23.720376 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:25.720364941 +0000 UTC m=+49.114357625 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : configmap "kube-rbac-proxy" not found Jun 16 19:49:24.192505 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.192454 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d2zm_71bce5d7-8b94-4548-89c1-4b8fd80928d3/serve-healthcheck-canary/0.log" Jun 16 19:49:24.792793 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.792762 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8zmfq"] Jun 16 19:49:24.805774 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.805747 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:24.806264 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.806230 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8zmfq"] Jun 16 19:49:24.809667 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.809635 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 16 19:49:24.810627 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.810592 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-8hl58\"" Jun 16 19:49:24.810754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.810628 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 16 19:49:24.810754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.810641 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 16 19:49:24.810754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.810714 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 16 19:49:24.833015 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.832978 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:24.923908 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.923867 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:24.932730 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.932694 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-key\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:24.932910 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.932894 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsvbh\" (UniqueName: \"kubernetes.io/projected/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-kube-api-access-nsvbh\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:24.933022 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.932999 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-cabundle\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:24.993228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.993195 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:24.993385 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.993253 2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:24.993678 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:24.993659 2550 scope.go:117] "RemoveContainer" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" Jun 16 19:49:24.993835 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:24.993816 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:25.033941 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.033904 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-key\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.034140 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.034121 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nsvbh\" (UniqueName: \"kubernetes.io/projected/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-kube-api-access-nsvbh\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.034404 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.034377 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-cabundle\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.035198 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.035173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-cabundle\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.036676 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.036653 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-signing-key\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.050115 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.050041 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsvbh\" (UniqueName: \"kubernetes.io/projected/2cec1089-2ba1-42c7-9cc8-b1126b84dfd1-kube-api-access-nsvbh\") pod \"service-ca-7b994bc59-8zmfq\" (UID: \"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1\") " pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.115549 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.115508 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" Jun 16 19:49:25.653913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.653885 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7b994bc59-8zmfq"] Jun 16 19:49:25.656553 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:25.656523 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cec1089_2ba1_42c7_9cc8_b1126b84dfd1.slice/crio-8abe84999096781a3fbefee2cf21146c28dd630822a11ea92e305af5b0d8b11e WatchSource:0}: Error finding container 8abe84999096781a3fbefee2cf21146c28dd630822a11ea92e305af5b0d8b11e: Status 404 returned error can't find the container with id 8abe84999096781a3fbefee2cf21146c28dd630822a11ea92e305af5b0d8b11e Jun 16 19:49:25.740540 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.740517 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:25.740649 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.740576 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:25.740711 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:25.740657 2550 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 16 19:49:25.740711 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:25.740685 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 16 19:49:25.740811 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:25.740730 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:29.740709272 +0000 UTC m=+53.134701969 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : configmap "kube-rbac-proxy" not found Jun 16 19:49:25.740811 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:25.740750 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:29.740740385 +0000 UTC m=+53.134733071 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : secret "insights-runtime-extractor-tls" not found Jun 16 19:49:25.840889 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:25.840856 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:26.120039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.119996 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:26.372492 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.372382 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" event={"ID":"4ac29a92-177c-45dd-8eed-1b3f7ae3e948","Type":"ContainerStarted","Data":"929f3e2d168933b2c730cf107e915a03069aa91dd914c66b405e56c66b99f8a5"} Jun 16 19:49:26.372798 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.372758 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" event={"ID":"4ac29a92-177c-45dd-8eed-1b3f7ae3e948","Type":"ContainerStarted","Data":"c9a425ce11e881456f930e4a5eba3c06217174f8cf5f913eec339bccb38cc099"} Jun 16 19:49:26.374043 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.374020 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" event={"ID":"39baf35c-b9d4-4f7c-80ae-a413754114ce","Type":"ContainerStarted","Data":"b659853811e54e0c4124e0459b6fd69a7fd63664b4db0adefd446206eadd4517"} Jun 16 19:49:26.375550 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.375524 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" event={"ID":"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1","Type":"ContainerStarted","Data":"e6138b5793338cb1b1314775db3d031171b695256956b2ec233a6ce213ea29b2"} Jun 16 19:49:26.375626 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.375576 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" event={"ID":"2cec1089-2ba1-42c7-9cc8-b1126b84dfd1","Type":"ContainerStarted","Data":"8abe84999096781a3fbefee2cf21146c28dd630822a11ea92e305af5b0d8b11e"} Jun 16 19:49:26.397082 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.397022 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-r42rw" podStartSLOduration=2.1083055059999998 podStartE2EDuration="4.39700449s" totalImagesPullingTime="2.288698984s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:26.396413351 +0000 UTC m=+49.790406058" watchObservedRunningTime="2026-06-16 19:49:26.39700449 +0000 UTC m=+49.790997198" Jun 16 19:49:26.423387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.423330 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7b994bc59-8zmfq" podStartSLOduration=2.423314544 podStartE2EDuration="2.423314544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:26.422635878 +0000 UTC m=+49.816628587" watchObservedRunningTime="2026-06-16 19:49:26.423314544 +0000 UTC m=+49.817307250" Jun 16 19:49:26.449073 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:26.449008 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6947749cfc-78dqb" podStartSLOduration=1.808050726 podStartE2EDuration="5.448989789s" totalImagesPullingTime="3.640939063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:26.448977192 +0000 UTC m=+49.842969893" watchObservedRunningTime="2026-06-16 19:49:26.448989789 +0000 UTC m=+49.842982494" Jun 16 19:49:27.060436 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.060399 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:27.337331 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.337230 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:27.438105 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.438067 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:27.600617 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.600523 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:27.964815 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.964774 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:27.965039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.964930 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:27.965039 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:27.964936 2550 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 16 19:49:27.965039 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:27.965011 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls podName:2f8f80fc-7079-472c-83de-9de737fd0b4a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:43.964994882 +0000 UTC m=+67.358987566 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls") pod "dns-default-zr5jp" (UID: "2f8f80fc-7079-472c-83de-9de737fd0b4a") : secret "dns-default-metrics-tls" not found Jun 16 19:49:27.965205 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:27.965064 2550 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 16 19:49:27.965205 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:27.965083 2550 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-74b6cf5f5-rd2pp: secret "image-registry-tls" not found Jun 16 19:49:27.965205 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:27.965165 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls podName:43a6f9b4-e5b7-4205-a512-b7f918d6f94f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:43.965148644 +0000 UTC m=+67.359141349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls") pod "image-registry-74b6cf5f5-rd2pp" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f") : secret "image-registry-tls" not found Jun 16 19:49:27.994931 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:27.994896 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:28.353853 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:28.353762 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:28.667856 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:28.667817 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.194689 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.194655 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.354437 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.354401 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.439561 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.439515 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.748523 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.748462 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.783106 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.783049 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:29.783317 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.783162 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:29.783317 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:29.783209 2550 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 16 19:49:29.783317 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:29.783282 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls podName:8b7b97f2-abc7-4501-9d59-413a9ccb196f nodeName:}" failed. No retries permitted until 2026-06-16 19:49:37.783264137 +0000 UTC m=+61.177256820 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-kd8fl" (UID: "8b7b97f2-abc7-4501-9d59-413a9ccb196f") : secret "insights-runtime-extractor-tls" not found Jun 16 19:49:29.783778 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.783753 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8b7b97f2-abc7-4501-9d59-413a9ccb196f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:29.851701 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.851658 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:29.953958 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:29.953912 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:30.370326 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.370293 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:30.388264 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.388236 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:30.388400 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:30.388385 2550 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:30.388458 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:30.388448 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls podName:b7c6e32c-259e-4921-9914-474327435dd2 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:46.388430379 +0000 UTC m=+69.782423072 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-f9d7df769-xcrq7" (UID: "b7c6e32c-259e-4921-9914-474327435dd2") : secret "cluster-monitoring-operator-tls" not found Jun 16 19:49:30.472397 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.472348 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:30.586228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.586191 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:30.590641 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.590612 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:30.593050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.593026 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b4d1a074-0521-41f3-9470-6fd3e560d427-samples-operator-tls\") pod \"cluster-samples-operator-9547488fd-vrx44\" (UID: \"b4d1a074-0521-41f3-9470-6fd3e560d427\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:30.607392 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.607363 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" Jun 16 19:49:30.691995 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.691966 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:30.692135 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.692014 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:30.692181 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:30.692135 2550 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 16 19:49:30.692181 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:30.692158 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:46.692144856 +0000 UTC m=+70.086137540 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : configmap references non-existent config key: service-ca.crt Jun 16 19:49:30.692264 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:30.692200 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs podName:ae217bed-f919-49eb-abb3-6d80b44c7486 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:46.692182344 +0000 UTC m=+70.086175033 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs") pod "router-default-7cf7bff7c4-t7mkh" (UID: "ae217bed-f919-49eb-abb3-6d80b44c7486") : secret "router-metrics-certs-default" not found Jun 16 19:49:30.735443 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.735410 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44"] Jun 16 19:49:30.955206 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:30.955115 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:31.077915 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:31.077883 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:31.360900 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:31.360815 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:31.399692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:31.399652 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" event={"ID":"b4d1a074-0521-41f3-9470-6fd3e560d427","Type":"ContainerStarted","Data":"16ae7e318582b6e0cbb1a73da727ef4ff09538c3c08321aa7571e7069dcc3dfb"} Jun 16 19:49:32.354826 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:32.354780 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:32.431362 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:32.431310 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:32.546754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:32.546711 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:33.408435 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.408392 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" event={"ID":"b4d1a074-0521-41f3-9470-6fd3e560d427","Type":"ContainerStarted","Data":"589e0cda5fa4a7993ca1ed393c5686d91cb7fdbc24fd4e1228f00178df84c35f"} Jun 16 19:49:33.408628 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.408459 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" event={"ID":"b4d1a074-0521-41f3-9470-6fd3e560d427","Type":"ContainerStarted","Data":"46dace049d32b4d4697e2d5247c6b0a36e3508f9368a29b43a4699a4e812e0f6"} Jun 16 19:49:33.429709 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.429652 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-9547488fd-vrx44" podStartSLOduration=17.69668279 podStartE2EDuration="19.429634027s" totalImagesPullingTime="1.732951237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:33.428738674 +0000 UTC m=+56.822731379" watchObservedRunningTime="2026-06-16 19:49:33.429634027 +0000 UTC m=+56.823626778" Jun 16 19:49:33.549815 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.549782 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:33.618818 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.618770 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:33.760850 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.760761 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:33.991092 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:33.991054 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:34.351827 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:34.351786 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:34.562189 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:34.562152 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:34.774221 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:34.774186 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:34.978559 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:34.978527 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:35.957995 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:35.957954 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:36.356068 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:36.355973 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:36.553352 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:36.553321 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:36.775047 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:36.775005 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:36.971241 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:36.971204 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:37.285831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.285805 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-94ss8" Jun 16 19:49:37.550818 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.550718 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:37.709337 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.709302 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:37.787542 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.787500 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:37.857608 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.857507 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:37.859761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.859741 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8b7b97f2-abc7-4501-9d59-413a9ccb196f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kd8fl\" (UID: \"8b7b97f2-abc7-4501-9d59-413a9ccb196f\") " pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:37.940115 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.940081 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27kct\"" Jun 16 19:49:37.948257 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:37.948235 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kd8fl" Jun 16 19:49:38.081835 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.081784 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kd8fl"] Jun 16 19:49:38.084453 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:38.084428 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7b97f2_abc7_4501_9d59_413a9ccb196f.slice/crio-3c31afa12f1ec170f30c6ecd376f23eec14bd6c70c9e278b08172fcf4a5eb698 WatchSource:0}: Error finding container 3c31afa12f1ec170f30c6ecd376f23eec14bd6c70c9e278b08172fcf4a5eb698: Status 404 returned error can't find the container with id 3c31afa12f1ec170f30c6ecd376f23eec14bd6c70c9e278b08172fcf4a5eb698 Jun 16 19:49:38.089548 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.089530 2550 scope.go:117] "RemoveContainer" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" Jun 16 19:49:38.426732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.426661 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:49:38.427023 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.427010 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/1.log" Jun 16 19:49:38.427072 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.427039 2550 generic.go:356] "Generic (PLEG): container finished" podID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" containerID="70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2" exitCode=255 Jun 16 19:49:38.427119 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.427105 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" event={"ID":"8a2d9f6f-ac73-4b77-80b7-af46215799ca","Type":"ContainerDied","Data":"70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2"} Jun 16 19:49:38.427178 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.427160 2550 scope.go:117] "RemoveContainer" containerID="32f807aa019980cd2b2125ba35e3698c69c134166b9301882bae23a5c3a31002" Jun 16 19:49:38.427552 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.427532 2550 scope.go:117] "RemoveContainer" containerID="70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2" Jun 16 19:49:38.427746 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:38.427718 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:38.428297 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:38.428274 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd8fl" event={"ID":"8b7b97f2-abc7-4501-9d59-413a9ccb196f","Type":"ContainerStarted","Data":"3c31afa12f1ec170f30c6ecd376f23eec14bd6c70c9e278b08172fcf4a5eb698"} Jun 16 19:49:39.433443 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:39.433409 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:49:42.446652 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.446558 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd8fl" event={"ID":"8b7b97f2-abc7-4501-9d59-413a9ccb196f","Type":"ContainerStarted","Data":"4b7e1f1f4eb7848f2fd305359cd9d21801af901dd677a625984c32731f96fb97"} Jun 16 19:49:42.446652 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.446616 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd8fl" event={"ID":"8b7b97f2-abc7-4501-9d59-413a9ccb196f","Type":"ContainerStarted","Data":"87d515a097d06bc4a8742aa472d13d6aae58c21e00f2c6563a4c8c94c52b4d49"} Jun 16 19:49:42.905062 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.905023 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:42.905273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.905092 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:42.905273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.905147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:42.907864 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.907830 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxc5\" (UniqueName: \"kubernetes.io/projected/07b1cdec-a31e-4f6b-b41e-e16e6c0cc073-kube-api-access-lvxc5\") pod \"network-check-target-9xq5j\" (UID: \"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073\") " pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:42.908263 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.908246 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:49:42.909116 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.909096 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:49:42.937714 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.937674 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/12e4ef9d-c15d-4dff-85f5-00c7e7388fc8-metrics-certs\") pod \"network-metrics-daemon-lh5r9\" (UID: \"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8\") " pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:42.937890 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.937763 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/14609d38-5cf6-4c6f-be87-f29cc29ac4e7-original-pull-secret\") pod \"global-pull-secret-syncer-lbx28\" (UID: \"14609d38-5cf6-4c6f-be87-f29cc29ac4e7\") " pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:42.998261 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:42.998221 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-lbx28" Jun 16 19:49:43.006078 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.006050 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:49:43.013669 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.013640 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lh5r9" Jun 16 19:49:43.102630 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.102505 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:49:43.110258 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.110224 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:43.167750 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.167691 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-lbx28"] Jun 16 19:49:43.171034 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:43.171000 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14609d38_5cf6_4c6f_be87_f29cc29ac4e7.slice/crio-59fb658c5d970aa6c4713049edc792cb123f44b085fb978161e4d44484e210aa WatchSource:0}: Error finding container 59fb658c5d970aa6c4713049edc792cb123f44b085fb978161e4d44484e210aa: Status 404 returned error can't find the container with id 59fb658c5d970aa6c4713049edc792cb123f44b085fb978161e4d44484e210aa Jun 16 19:49:43.193520 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.193486 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lh5r9"] Jun 16 19:49:43.196240 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:43.196212 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e4ef9d_c15d_4dff_85f5_00c7e7388fc8.slice/crio-994fa62b8b944ffd757242df92a04801e5e366718214f85a9e44b62717e66b5a WatchSource:0}: Error finding container 994fa62b8b944ffd757242df92a04801e5e366718214f85a9e44b62717e66b5a: Status 404 returned error can't find the container with id 994fa62b8b944ffd757242df92a04801e5e366718214f85a9e44b62717e66b5a Jun 16 19:49:43.284666 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.284580 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9xq5j"] Jun 16 19:49:43.286994 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:43.286967 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07b1cdec_a31e_4f6b_b41e_e16e6c0cc073.slice/crio-40010f7accc58dbd1f3910eb70bd62bfb1ec7f7da1e8bef385bf3b88c7fc8073 WatchSource:0}: Error finding container 40010f7accc58dbd1f3910eb70bd62bfb1ec7f7da1e8bef385bf3b88c7fc8073: Status 404 returned error can't find the container with id 40010f7accc58dbd1f3910eb70bd62bfb1ec7f7da1e8bef385bf3b88c7fc8073 Jun 16 19:49:43.452366 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.452285 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq5j" event={"ID":"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073","Type":"ContainerStarted","Data":"85d93213825fc30d02e2c5d5620f4a2f1731f53198b551e7b5ea55cc1d1fc55e"} Jun 16 19:49:43.452366 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.452346 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9xq5j" event={"ID":"07b1cdec-a31e-4f6b-b41e-e16e6c0cc073","Type":"ContainerStarted","Data":"40010f7accc58dbd1f3910eb70bd62bfb1ec7f7da1e8bef385bf3b88c7fc8073"} Jun 16 19:49:43.452876 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.452403 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:49:43.453772 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.453739 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lh5r9" event={"ID":"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8","Type":"ContainerStarted","Data":"994fa62b8b944ffd757242df92a04801e5e366718214f85a9e44b62717e66b5a"} Jun 16 19:49:43.454881 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.454851 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lbx28" event={"ID":"14609d38-5cf6-4c6f-be87-f29cc29ac4e7","Type":"ContainerStarted","Data":"59fb658c5d970aa6c4713049edc792cb123f44b085fb978161e4d44484e210aa"} Jun 16 19:49:43.470441 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.470392 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9xq5j" podStartSLOduration=66.470377551 podStartE2EDuration="1m6.470377551s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:43.469385738 +0000 UTC m=+66.863378467" watchObservedRunningTime="2026-06-16 19:49:43.470377551 +0000 UTC m=+66.864370258" Jun 16 19:49:43.958011 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.957977 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9c796"] Jun 16 19:49:43.993983 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.993945 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9c796"] Jun 16 19:49:43.994156 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.994046 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:43.996466 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.996438 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gpjtr\"" Jun 16 19:49:43.996466 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.996483 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 16 19:49:43.997424 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:43.997402 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 16 19:49:44.016089 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.016060 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:44.016230 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.016108 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:44.018554 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.018527 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2f8f80fc-7079-472c-83de-9de737fd0b4a-metrics-tls\") pod \"dns-default-zr5jp\" (UID: \"2f8f80fc-7079-472c-83de-9de737fd0b4a\") " pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:44.018730 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.018707 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"image-registry-74b6cf5f5-rd2pp\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:44.030268 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.030236 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.115433 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.115357 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.117363 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.117335 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b24991b-90bd-4742-bbc7-556b574ff122-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.117582 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.117383 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b24991b-90bd-4742-bbc7-556b574ff122-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.132823 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.132791 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dm8ww\"" Jun 16 19:49:44.141809 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.141778 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:44.158711 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.158466 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9jnd\"" Jun 16 19:49:44.167450 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.166846 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:44.207152 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.207114 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.218302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.218227 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b24991b-90bd-4742-bbc7-556b574ff122-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.218302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.218282 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b24991b-90bd-4742-bbc7-556b574ff122-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.219076 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.219050 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6b24991b-90bd-4742-bbc7-556b574ff122-nginx-conf\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.222067 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.222041 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6b24991b-90bd-4742-bbc7-556b574ff122-networking-console-plugin-cert\") pod \"networking-console-plugin-867b76cb74-9c796\" (UID: \"6b24991b-90bd-4742-bbc7-556b574ff122\") " pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.304359 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.304320 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" Jun 16 19:49:44.316827 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.316784 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:49:44.320410 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:44.320380 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a6f9b4_e5b7_4205_a512_b7f918d6f94f.slice/crio-ffa197a30134e77a8b39e0f2544718092592bc42b54f16ea8bfb9b1c08d34cdf WatchSource:0}: Error finding container ffa197a30134e77a8b39e0f2544718092592bc42b54f16ea8bfb9b1c08d34cdf: Status 404 returned error can't find the container with id ffa197a30134e77a8b39e0f2544718092592bc42b54f16ea8bfb9b1c08d34cdf Jun 16 19:49:44.321545 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.321441 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.357131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.357097 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zr5jp"] Jun 16 19:49:44.361664 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:44.361620 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f8f80fc_7079_472c_83de_9de737fd0b4a.slice/crio-266e838563f6d204346b565856d0a4ac69548270335d51d04930f425745157f2 WatchSource:0}: Error finding container 266e838563f6d204346b565856d0a4ac69548270335d51d04930f425745157f2: Status 404 returned error can't find the container with id 266e838563f6d204346b565856d0a4ac69548270335d51d04930f425745157f2 Jun 16 19:49:44.420984 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.420923 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.460659 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.460627 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zr5jp" event={"ID":"2f8f80fc-7079-472c-83de-9de737fd0b4a","Type":"ContainerStarted","Data":"266e838563f6d204346b565856d0a4ac69548270335d51d04930f425745157f2"} Jun 16 19:49:44.462525 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.462501 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" event={"ID":"43a6f9b4-e5b7-4205-a512-b7f918d6f94f","Type":"ContainerStarted","Data":"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64"} Jun 16 19:49:44.462647 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.462546 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" event={"ID":"43a6f9b4-e5b7-4205-a512-b7f918d6f94f","Type":"ContainerStarted","Data":"ffa197a30134e77a8b39e0f2544718092592bc42b54f16ea8bfb9b1c08d34cdf"} Jun 16 19:49:44.462647 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.462599 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:49:44.465403 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.465380 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kd8fl" event={"ID":"8b7b97f2-abc7-4501-9d59-413a9ccb196f","Type":"ContainerStarted","Data":"de4756707ae51da3ca1b3ed811f1c14529e434e9af402135f74bc8dbf83d5ea0"} Jun 16 19:49:44.476822 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.476777 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-867b76cb74-9c796"] Jun 16 19:49:44.488229 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.488172 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" podStartSLOduration=67.488152163 podStartE2EDuration="1m7.488152163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:44.488135705 +0000 UTC m=+67.882128509" watchObservedRunningTime="2026-06-16 19:49:44.488152163 +0000 UTC m=+67.882144872" Jun 16 19:49:44.490444 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.490405 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.507706 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.507648 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kd8fl" podStartSLOduration=17.680846614 podStartE2EDuration="23.507626907s" totalImagesPullingTime="5.826780293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:44.506822074 +0000 UTC m=+67.900814781" watchObservedRunningTime="2026-06-16 19:49:44.507626907 +0000 UTC m=+67.901619614" Jun 16 19:49:44.668655 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:44.668617 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b24991b_90bd_4742_bbc7_556b574ff122.slice/crio-f77b5e8b2df7e46657a8300a40d3cb12691e56627e45a3e94087dd4d8a9ace3f WatchSource:0}: Error finding container f77b5e8b2df7e46657a8300a40d3cb12691e56627e45a3e94087dd4d8a9ace3f: Status 404 returned error can't find the container with id f77b5e8b2df7e46657a8300a40d3cb12691e56627e45a3e94087dd4d8a9ace3f Jun 16 19:49:44.814002 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.813944 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.912344 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.912309 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:44.993882 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.993799 2550 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:44.993882 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.993853 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:49:44.994237 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:44.994202 2550 scope.go:117] "RemoveContainer" containerID="70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2" Jun 16 19:49:44.994425 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:44.994404 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:45.474161 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.474110 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" event={"ID":"6b24991b-90bd-4742-bbc7-556b574ff122","Type":"ContainerStarted","Data":"f77b5e8b2df7e46657a8300a40d3cb12691e56627e45a3e94087dd4d8a9ace3f"} Jun 16 19:49:45.477592 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.477544 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lh5r9" event={"ID":"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8","Type":"ContainerStarted","Data":"7fdb3a5cd1d44cff7706c75e06954063abff97ffe9d54b2fdb08798345424cdb"} Jun 16 19:49:45.477775 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.477611 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lh5r9" event={"ID":"12e4ef9d-c15d-4dff-85f5-00c7e7388fc8","Type":"ContainerStarted","Data":"ebf4facf104e69aa4f0a6960c2f075dcf6c46ff9e4d52f4956a7ed5b45616d2f"} Jun 16 19:49:45.624265 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.624205 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:45.691041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.690994 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:45.752961 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:45.752850 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:46.341040 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.340950 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:46.406433 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.406398 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:46.440299 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.440264 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:46.443231 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.443204 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/b7c6e32c-259e-4921-9914-474327435dd2-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-f9d7df769-xcrq7\" (UID: \"b7c6e32c-259e-4921-9914-474327435dd2\") " pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:46.483418 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.483375 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" event={"ID":"6b24991b-90bd-4742-bbc7-556b574ff122","Type":"ContainerStarted","Data":"ca78e52054fc6cf9490cc7e2d9f0c668d12db6ba0635fc242ea5526cf7a217dc"} Jun 16 19:49:46.504237 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.504180 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-867b76cb74-9c796" podStartSLOduration=2.123464284 podStartE2EDuration="3.504158277s" totalImagesPullingTime="1.380693993s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:46.503285366 +0000 UTC m=+69.897278085" watchObservedRunningTime="2026-06-16 19:49:46.504158277 +0000 UTC m=+69.898150984" Jun 16 19:49:46.504437 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.504272 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lh5r9" podStartSLOduration=67.988126022 podStartE2EDuration="1m9.504263992s" totalImagesPullingTime="1.51613797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:45.497372923 +0000 UTC m=+68.891365630" watchObservedRunningTime="2026-06-16 19:49:46.504263992 +0000 UTC m=+69.898256699" Jun 16 19:49:46.567305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.567273 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-vqtn8\"" Jun 16 19:49:46.574736 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.574661 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" Jun 16 19:49:46.628701 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.628666 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:46.731204 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.731105 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:46.742773 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.742747 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:46.742854 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.742800 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:46.743426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.743401 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae217bed-f919-49eb-abb3-6d80b44c7486-service-ca-bundle\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:46.745226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.745198 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ae217bed-f919-49eb-abb3-6d80b44c7486-metrics-certs\") pod \"router-default-7cf7bff7c4-t7mkh\" (UID: \"ae217bed-f919-49eb-abb3-6d80b44c7486\") " pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:46.825369 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.825338 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7"] Jun 16 19:49:46.827903 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:46.827874 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7c6e32c_259e_4921_9914_474327435dd2.slice/crio-209d4b665532d0727b5b72d738b65af7cdd0e2806d349f3a076bc29a379c9e8b WatchSource:0}: Error finding container 209d4b665532d0727b5b72d738b65af7cdd0e2806d349f3a076bc29a379c9e8b: Status 404 returned error can't find the container with id 209d4b665532d0727b5b72d738b65af7cdd0e2806d349f3a076bc29a379c9e8b Jun 16 19:49:46.849680 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.849654 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-t5ws9\"" Jun 16 19:49:46.857824 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:46.857760 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:47.017143 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.017112 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7cf7bff7c4-t7mkh"] Jun 16 19:49:47.020124 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:49:47.020097 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae217bed_f919_49eb_abb3_6d80b44c7486.slice/crio-1b1165a17dc0d92e06f01de99ee4f5b7887f0c44e427d86eafb97509fdbe36f5 WatchSource:0}: Error finding container 1b1165a17dc0d92e06f01de99ee4f5b7887f0c44e427d86eafb97509fdbe36f5: Status 404 returned error can't find the container with id 1b1165a17dc0d92e06f01de99ee4f5b7887f0c44e427d86eafb97509fdbe36f5 Jun 16 19:49:47.463241 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.463204 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:47.491405 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.491342 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zr5jp" event={"ID":"2f8f80fc-7079-472c-83de-9de737fd0b4a","Type":"ContainerStarted","Data":"2f9741060ef4fe1475b4c2d63c2903f3d929bb61fa9c00fbbf2e06b8598cbc28"} Jun 16 19:49:47.491930 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.491445 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zr5jp" event={"ID":"2f8f80fc-7079-472c-83de-9de737fd0b4a","Type":"ContainerStarted","Data":"7c655990fec546975b5683f2aefa2e69c9327d1e28666915f4170bf5177b637c"} Jun 16 19:49:47.491930 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.491734 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:47.493428 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.493375 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" event={"ID":"b7c6e32c-259e-4921-9914-474327435dd2","Type":"ContainerStarted","Data":"209d4b665532d0727b5b72d738b65af7cdd0e2806d349f3a076bc29a379c9e8b"} Jun 16 19:49:47.495801 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.495383 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" event={"ID":"ae217bed-f919-49eb-abb3-6d80b44c7486","Type":"ContainerStarted","Data":"45a9cf3f665d4e85b79447b29267bee3c12aa63ffe653bcf4ef88e886fba033f"} Jun 16 19:49:47.495801 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.495422 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" event={"ID":"ae217bed-f919-49eb-abb3-6d80b44c7486","Type":"ContainerStarted","Data":"1b1165a17dc0d92e06f01de99ee4f5b7887f0c44e427d86eafb97509fdbe36f5"} Jun 16 19:49:47.518351 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.518245 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zr5jp" podStartSLOduration=34.154012336 podStartE2EDuration="36.518230596s" totalImagesPullingTime="2.36421826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:47.515782045 +0000 UTC m=+70.909774762" watchObservedRunningTime="2026-06-16 19:49:47.518230596 +0000 UTC m=+70.912223303" Jun 16 19:49:47.541855 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.541794 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" podStartSLOduration=33.541774896 podStartE2EDuration="33.541774896s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:47.541149805 +0000 UTC m=+70.935142513" watchObservedRunningTime="2026-06-16 19:49:47.541774896 +0000 UTC m=+70.935767605" Jun 16 19:49:47.821879 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.821790 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:47.858720 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.858692 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:47.861225 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.861199 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:47.902143 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:47.902087 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:48.499999 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:48.499960 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:48.501179 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:48.501158 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7cf7bff7c4-t7mkh" Jun 16 19:49:49.712516 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:49.712463 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:49.791084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:49.791048 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:49.962811 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:49.962721 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.042770 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.042721 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.137050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.137009 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.231194 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.231102 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.302584 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.302543 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.401865 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.401832 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:50.964001 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:50.963963 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.064911 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.064876 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.153807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.153773 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.226439 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.226345 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.420122 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.420083 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.518566 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.514246 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-lbx28" event={"ID":"14609d38-5cf6-4c6f-be87-f29cc29ac4e7","Type":"ContainerStarted","Data":"da2540e410a2a60e8618ced64d67946b9e5ed55dda67783b6343a14a6bbfa898"} Jun 16 19:49:51.520723 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.520662 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:51.520879 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.520732 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" event={"ID":"b7c6e32c-259e-4921-9914-474327435dd2","Type":"ContainerStarted","Data":"82c631575ee1c83f51561ce42ed23aff4955421d2fcf5d0e5a53ea38407ad749"} Jun 16 19:49:51.535353 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.535291 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-lbx28" podStartSLOduration=67.103004183 podStartE2EDuration="1m14.53526927s" totalImagesPullingTime="7.432265087s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:51.533634213 +0000 UTC m=+74.927626968" watchObservedRunningTime="2026-06-16 19:49:51.53526927 +0000 UTC m=+74.929261977" Jun 16 19:49:51.554735 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.554671 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-f9d7df769-xcrq7" podStartSLOduration=33.789879873 podStartE2EDuration="37.554651077s" totalImagesPullingTime="3.764771204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:51.553555104 +0000 UTC m=+74.947547814" watchObservedRunningTime="2026-06-16 19:49:51.554651077 +0000 UTC m=+74.948643782" Jun 16 19:49:51.807586 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:51.807464 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:56.090267 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:56.090148 2550 scope.go:117] "RemoveContainer" containerID="70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2" Jun 16 19:49:56.090801 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:49:56.090333 2550 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-5dbbb5d744-r6tp8_openshift-console-operator(8a2d9f6f-ac73-4b77-80b7-af46215799ca)\"" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podUID="8a2d9f6f-ac73-4b77-80b7-af46215799ca" Jun 16 19:49:57.501671 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:57.501635 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zr5jp" Jun 16 19:49:59.175642 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:59.175603 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:59.263380 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:59.263337 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:59.336867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:59.336826 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:59.827048 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:59.827004 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:49:59.927773 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:49:59.927735 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:02.328769 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:02.328734 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:03.815222 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:03.815178 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.146426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.146390 2550 patch_prober.go:28] interesting pod/image-registry-74b6cf5f5-rd2pp container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 16 19:50:04.146628 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.146452 2550 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 16 19:50:04.338882 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.338844 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.569341 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.569252 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.634582 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.634542 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m9xf8"] Jun 16 19:50:04.639209 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.639188 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.641548 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.641524 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 16 19:50:04.641695 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.641678 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 16 19:50:04.641809 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.641703 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 16 19:50:04.641886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.641793 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xndj5\"" Jun 16 19:50:04.642402 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.642380 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 16 19:50:04.646132 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.646099 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.683561 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683522 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-sys\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683624 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lthbt\" (UniqueName: \"kubernetes.io/projected/41207e94-3a0d-4a2c-b81f-6340689d0c21-kube-api-access-lthbt\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683663 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683690 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-root\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683716 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-wtmp\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683896 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683752 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683896 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683811 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-textfile\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.683896 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683871 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.684005 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.683912 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-metrics-client-ca\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.773377 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.773327 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.784342 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784314 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-metrics-client-ca\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784465 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784368 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-sys\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784465 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784400 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lthbt\" (UniqueName: \"kubernetes.io/projected/41207e94-3a0d-4a2c-b81f-6340689d0c21-kube-api-access-lthbt\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784465 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784430 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784465 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784458 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-root\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784683 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784496 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-wtmp\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784683 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784514 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-sys\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784683 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784531 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784683 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784579 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-textfile\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784683 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784627 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.784926 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:50:04.784743 2550 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 16 19:50:04.784926 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:50:04.784799 2550 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls podName:41207e94-3a0d-4a2c-b81f-6340689d0c21 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:05.284779191 +0000 UTC m=+88.678771878 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls") pod "node-exporter-m9xf8" (UID: "41207e94-3a0d-4a2c-b81f-6340689d0c21") : secret "node-exporter-tls" not found Jun 16 19:50:04.785050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.784968 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-root\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.785050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.785007 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-textfile\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.785162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.785048 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-accelerators-collector-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.785162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.785077 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41207e94-3a0d-4a2c-b81f-6340689d0c21-metrics-client-ca\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.785162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.785109 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-wtmp\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.787018 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.786995 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.794198 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.794171 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lthbt\" (UniqueName: \"kubernetes.io/projected/41207e94-3a0d-4a2c-b81f-6340689d0c21-kube-api-access-lthbt\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:04.873960 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.873807 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:04.975195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:04.975154 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:05.078464 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.078430 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:05.218214 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.218130 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:05.288293 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.288261 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:05.290383 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.290360 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/41207e94-3a0d-4a2c-b81f-6340689d0c21-node-exporter-tls\") pod \"node-exporter-m9xf8\" (UID: \"41207e94-3a0d-4a2c-b81f-6340689d0c21\") " pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:05.481952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.481863 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:50:05.549999 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.549965 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m9xf8" Jun 16 19:50:05.564072 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:50:05.564042 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41207e94_3a0d_4a2c_b81f_6340689d0c21.slice/crio-468acd00e4268db90604b4b658fa6dd6b8ea3dd08fefc0b20855028fcd876456 WatchSource:0}: Error finding container 468acd00e4268db90604b4b658fa6dd6b8ea3dd08fefc0b20855028fcd876456: Status 404 returned error can't find the container with id 468acd00e4268db90604b4b658fa6dd6b8ea3dd08fefc0b20855028fcd876456 Jun 16 19:50:05.577157 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.577129 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9xf8" event={"ID":"41207e94-3a0d-4a2c-b81f-6340689d0c21","Type":"ContainerStarted","Data":"468acd00e4268db90604b4b658fa6dd6b8ea3dd08fefc0b20855028fcd876456"} Jun 16 19:50:05.606784 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.606744 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:05.699931 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.699890 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:05.898262 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:05.898224 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:06.014493 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:06.014443 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:06.704589 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:06.704549 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:06.804919 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:06.804885 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:07.357618 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.357531 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:07.587324 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.587295 2550 generic.go:356] "Generic (PLEG): container finished" podID="41207e94-3a0d-4a2c-b81f-6340689d0c21" containerID="9d7d1754a0576aa15dcc137edbfef53716ff6e938796e7bcc67507f7c2a24e5e" exitCode=0 Jun 16 19:50:07.587507 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.587361 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9xf8" event={"ID":"41207e94-3a0d-4a2c-b81f-6340689d0c21","Type":"ContainerDied","Data":"9d7d1754a0576aa15dcc137edbfef53716ff6e938796e7bcc67507f7c2a24e5e"} Jun 16 19:50:07.676735 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.676709 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:07.777343 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.777307 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:07.881030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.880940 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:07.998615 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:07.998581 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:08.425704 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.425665 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:08.490772 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.490731 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:08.549729 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.549699 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:08.597504 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.597452 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9xf8" event={"ID":"41207e94-3a0d-4a2c-b81f-6340689d0c21","Type":"ContainerStarted","Data":"e2542c5e4bc4d63087b260e5aee58c18f67c74ef3cb14edd3251365aa862855f"} Jun 16 19:50:08.597668 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.597556 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m9xf8" event={"ID":"41207e94-3a0d-4a2c-b81f-6340689d0c21","Type":"ContainerStarted","Data":"86b2e3b20b78cf445ab716dbcce8a90595aaa522081d060ff7901471926331c4"} Jun 16 19:50:08.621624 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:08.621564 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m9xf8" podStartSLOduration=3.274925668 podStartE2EDuration="4.621549944s" totalImagesPullingTime="1.284199571s" totalInitContainerRuntime="62.424705ms" isStatefulPod=true podCreationTimestamp="2026-06-16 19:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:08.619441775 +0000 UTC m=+92.013434500" watchObservedRunningTime="2026-06-16 19:50:08.621549944 +0000 UTC m=+92.015542650" Jun 16 19:50:09.090303 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.090266 2550 scope.go:117] "RemoveContainer" containerID="70333b1d11cfb101972c5f930441bfa2adf80912266cc41f30d6f914b99098d2" Jun 16 19:50:09.390908 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.390874 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:09.578377 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.578345 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:09.602639 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.602615 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:50:09.602787 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.602741 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" event={"ID":"8a2d9f6f-ac73-4b77-80b7-af46215799ca","Type":"ContainerStarted","Data":"fb33569e870bca6f466e3532d58a93edd6fa858d95e8e97cf812df17793ad464"} Jun 16 19:50:09.623437 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.623384 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" podStartSLOduration=50.263581866 podStartE2EDuration="55.623365384s" totalImagesPullingTime="5.359783518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:09.622196685 +0000 UTC m=+93.016189398" watchObservedRunningTime="2026-06-16 19:50:09.623365384 +0000 UTC m=+93.017358090" Jun 16 19:50:09.750078 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.749964 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:09.847993 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.847946 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:09.983588 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:09.983549 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:10.126170 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:10.126097 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:10.225056 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:10.225024 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:10.355393 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:10.355362 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:10.453353 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:10.453265 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:11.088081 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:11.088040 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:11.210925 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:11.210888 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:11.311402 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:11.311347 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:11.416835 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:11.416801 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:11.593748 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:11.593713 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:12.186320 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:12.186286 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:12.287272 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:12.287239 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:13.281295 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:13.281265 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:50:13.384396 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:13.384360 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:13.451908 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:13.451879 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:13.570106 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:13.570010 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:13.729260 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:13.729220 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:14.467976 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:14.467942 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9xq5j" Jun 16 19:50:15.204445 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:15.204410 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:15.969562 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:15.969527 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:16.069997 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:16.069960 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:16.438167 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:16.438129 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:18.271099 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:18.271056 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:18.374711 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:18.374668 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:19.603921 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.603887 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:50:19.607729 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.607705 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-5dbbb5d744-r6tp8" Jun 16 19:50:19.648953 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.648923 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:50:19.806360 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.806325 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:50:19.806556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.806420 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.810732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.810703 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 16 19:50:19.810732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.810718 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 16 19:50:19.810906 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.810813 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 16 19:50:19.810906 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.810862 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 16 19:50:19.810999 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.810984 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4rflm\"" Jun 16 19:50:19.811142 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.811126 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 16 19:50:19.811221 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.811205 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 16 19:50:19.811269 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.811220 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 16 19:50:19.900836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900765 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.900836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900815 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpvh9\" (UniqueName: \"kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.901087 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900898 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.901087 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900929 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.901087 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900958 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:19.901087 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:19.900977 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002043 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002006 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002047 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002067 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002119 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002153 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpvh9\" (UniqueName: \"kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002206 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002869 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002843 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002985 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002855 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.002985 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.002950 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.004898 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.004872 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.005095 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.005077 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.012128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.012104 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpvh9\" (UniqueName: \"kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9\") pod \"console-6c68c7f585-9xzcb\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.116491 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.116442 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:20.285453 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.285427 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:50:20.287932 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:50:20.287899 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf1844bc_8fe0_4bf0_b995_de5fd4f68b8c.slice/crio-96402453c23f47af34318b4b0798874c1e4b7ea376af063d8293d467591f3f1d WatchSource:0}: Error finding container 96402453c23f47af34318b4b0798874c1e4b7ea376af063d8293d467591f3f1d: Status 404 returned error can't find the container with id 96402453c23f47af34318b4b0798874c1e4b7ea376af063d8293d467591f3f1d Jun 16 19:50:20.646334 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:20.646295 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68c7f585-9xzcb" event={"ID":"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c","Type":"ContainerStarted","Data":"96402453c23f47af34318b4b0798874c1e4b7ea376af063d8293d467591f3f1d"} Jun 16 19:50:21.631924 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:21.631881 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:21.733897 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:21.733864 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:24.663844 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:24.663809 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68c7f585-9xzcb" event={"ID":"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c","Type":"ContainerStarted","Data":"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f"} Jun 16 19:50:24.688206 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:24.688041 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c68c7f585-9xzcb" podStartSLOduration=2.336483082 podStartE2EDuration="5.688022152s" totalImagesPullingTime="3.35153907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:24.687878893 +0000 UTC m=+108.081871624" watchObservedRunningTime="2026-06-16 19:50:24.688022152 +0000 UTC m=+108.082014859" Jun 16 19:50:24.792999 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:24.792962 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:24.893824 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:24.893791 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:25.030103 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:25.030007 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:25.135910 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:25.135871 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:26.585653 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:26.585614 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:28.390867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:28.390826 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:28.465758 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:28.465706 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:29.866511 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:29.866454 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:29.967014 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:29.966984 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:30.117274 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:30.117191 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:30.117274 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:30.117247 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:30.121907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:30.121865 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:30.695104 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:30.695074 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:50:32.280888 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:32.280850 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:32.382703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:32.382666 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:32.452907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:32.452869 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:36.522756 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.522719 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:36.623401 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.623364 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:36.689296 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.689259 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:36.713831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.713759 2550 generic.go:356] "Generic (PLEG): container finished" podID="e61b2f94-84e7-493b-a31b-2ab77c1c570f" containerID="7e62fe56b7102a03d01ee906e5631b711b4698c093f3336e316a52db5267ef9e" exitCode=0 Jun 16 19:50:36.713831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.713816 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" event={"ID":"e61b2f94-84e7-493b-a31b-2ab77c1c570f","Type":"ContainerDied","Data":"7e62fe56b7102a03d01ee906e5631b711b4698c093f3336e316a52db5267ef9e"} Jun 16 19:50:36.714135 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.714122 2550 scope.go:117] "RemoveContainer" containerID="7e62fe56b7102a03d01ee906e5631b711b4698c093f3336e316a52db5267ef9e" Jun 16 19:50:36.994132 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:36.994051 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:37.071522 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:37.071466 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:37.601239 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:37.601204 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:37.674173 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:37.674136 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:37.718789 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:37.718760 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-79mmm" event={"ID":"e61b2f94-84e7-493b-a31b-2ab77c1c570f","Type":"ContainerStarted","Data":"64ed587bf6d527ac8ff95602303c1b4721033d7ebe1f3d850b3d0c161c367a57"} Jun 16 19:50:38.301128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.301083 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerName="registry" containerID="cri-o://9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64" gracePeriod=30 Jun 16 19:50:38.542738 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.542712 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:50:38.658422 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658395 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658444 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jmzl9\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658494 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658523 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658572 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658604 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658644 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.658886 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.658733 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration\") pod \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\" (UID: \"43a6f9b4-e5b7-4205-a512-b7f918d6f94f\") " Jun 16 19:50:38.659253 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.659114 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:50:38.659332 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.659304 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:50:38.661204 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.661167 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9" (OuterVolumeSpecName: "kube-api-access-jmzl9") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "kube-api-access-jmzl9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:50:38.661204 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.661182 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:50:38.661375 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.661286 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:50:38.661433 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.661374 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:50:38.661433 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.661393 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:50:38.667077 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.667050 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "43a6f9b4-e5b7-4205-a512-b7f918d6f94f" (UID: "43a6f9b4-e5b7-4205-a512-b7f918d6f94f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:50:38.723914 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.723877 2550 generic.go:356] "Generic (PLEG): container finished" podID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerID="9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64" exitCode=0 Jun 16 19:50:38.724041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.723924 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" Jun 16 19:50:38.724041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.723955 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" event={"ID":"43a6f9b4-e5b7-4205-a512-b7f918d6f94f","Type":"ContainerDied","Data":"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64"} Jun 16 19:50:38.724041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.724002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-74b6cf5f5-rd2pp" event={"ID":"43a6f9b4-e5b7-4205-a512-b7f918d6f94f","Type":"ContainerDied","Data":"ffa197a30134e77a8b39e0f2544718092592bc42b54f16ea8bfb9b1c08d34cdf"} Jun 16 19:50:38.724041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.724022 2550 scope.go:117] "RemoveContainer" containerID="9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64" Jun 16 19:50:38.732011 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.731927 2550 scope.go:117] "RemoveContainer" containerID="9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64" Jun 16 19:50:38.732257 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:50:38.732227 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64\": container with ID starting with 9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64 not found: ID does not exist" containerID="9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64" Jun 16 19:50:38.732312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.732268 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64"} err="failed to get container status \"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64\": rpc error: code = NotFound desc = could not find container \"9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64\": container with ID starting with 9598dd200d3def176646ddb190bc0f9f061dd4c6634b6be50a689dcca7d94c64 not found: ID does not exist" Jun 16 19:50:38.747405 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.747380 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:50:38.753844 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.753825 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-74b6cf5f5-rd2pp"] Jun 16 19:50:38.759895 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759876 2550 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-image-registry-private-configuration\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759899 2550 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-bound-sa-token\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759909 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jmzl9\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-kube-api-access-jmzl9\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759918 2550 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-installation-pull-secrets\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759927 2550 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-trusted-ca\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759935 2550 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-certificates\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759943 2550 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-registry-tls\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:38.759963 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:38.759952 2550 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/43a6f9b4-e5b7-4205-a512-b7f918d6f94f-ca-trust-extracted\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:50:39.098802 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:39.098719 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" path="/var/lib/kubelet/pods/43a6f9b4-e5b7-4205-a512-b7f918d6f94f/volumes" Jun 16 19:50:39.196732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:39.196693 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:50:39.347314 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:39.347283 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:39.420171 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:39.420139 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:40.038988 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:40.038955 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:40.103020 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:40.102988 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:44.831528 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:44.831494 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:44.900906 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:44.900867 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:46.755069 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:46.755036 2550 generic.go:356] "Generic (PLEG): container finished" podID="f6c2fbf0-8de6-4906-81dc-6c305e610109" containerID="44e85f062c63b86ea94b2343eaf6ddeb5f5ad57653694482a478cd6ae4c239ac" exitCode=0 Jun 16 19:50:46.755450 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:46.755080 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" event={"ID":"f6c2fbf0-8de6-4906-81dc-6c305e610109","Type":"ContainerDied","Data":"44e85f062c63b86ea94b2343eaf6ddeb5f5ad57653694482a478cd6ae4c239ac"} Jun 16 19:50:46.755450 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:46.755370 2550 scope.go:117] "RemoveContainer" containerID="44e85f062c63b86ea94b2343eaf6ddeb5f5ad57653694482a478cd6ae4c239ac" Jun 16 19:50:47.760843 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:47.760810 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-lzswh" event={"ID":"f6c2fbf0-8de6-4906-81dc-6c305e610109","Type":"ContainerStarted","Data":"aadb9fba8f0f45b94018be84076434396fe1354f224e80c571d04b0935702346"} Jun 16 19:50:49.198339 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:49.198307 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:49.265804 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:49.265766 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:52.234761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:52.234730 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:52.303001 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:52.302960 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:55.349862 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:55.349807 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:55.424343 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:55.424311 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:56.792786 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:56.792753 2550 generic.go:356] "Generic (PLEG): container finished" podID="43555df0-5adb-46e0-a640-96da6ecbed9b" containerID="96f43a90b8f8ca025659213216e9c8fbce35369a9eb23b89c34515e549dbc257" exitCode=0 Jun 16 19:50:56.793175 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:56.792824 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" event={"ID":"43555df0-5adb-46e0-a640-96da6ecbed9b","Type":"ContainerDied","Data":"96f43a90b8f8ca025659213216e9c8fbce35369a9eb23b89c34515e549dbc257"} Jun 16 19:50:56.793175 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:56.793144 2550 scope.go:117] "RemoveContainer" containerID="96f43a90b8f8ca025659213216e9c8fbce35369a9eb23b89c34515e549dbc257" Jun 16 19:50:57.486121 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:57.486084 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:57.585844 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:57.585805 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:57.798099 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:57.798009 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5bbd86d6bd-gcgjh" event={"ID":"43555df0-5adb-46e0-a640-96da6ecbed9b","Type":"ContainerStarted","Data":"27f7b9560e68b101148bcb232ad546d0f86b7f363ff70341c798c55e8e0950c5"} Jun 16 19:50:59.816755 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:59.816711 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:50:59.884027 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:50:59.883988 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:04.216699 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.216652 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c68c7f585-9xzcb" podUID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" containerName="console" containerID="cri-o://e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f" gracePeriod=15 Jun 16 19:51:04.460637 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.460611 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:51:04.571317 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571230 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571317 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571272 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571570 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571325 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571570 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571442 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571682 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571567 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpvh9\" (UniqueName: \"kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571682 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571600 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config\") pod \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\" (UID: \"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c\") " Jun 16 19:51:04.571767 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571696 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca" (OuterVolumeSpecName: "service-ca") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:04.571826 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571773 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config" (OuterVolumeSpecName: "console-config") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:04.571879 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571823 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:04.571879 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571840 2550 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-service-ca\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.571958 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.571875 2550 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-config\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.573784 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.573740 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9" (OuterVolumeSpecName: "kube-api-access-bpvh9") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "kube-api-access-bpvh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:51:04.573895 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.573828 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:04.573895 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.573843 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" (UID: "cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:04.673088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.673044 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpvh9\" (UniqueName: \"kubernetes.io/projected/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-kube-api-access-bpvh9\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.673088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.673080 2550 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-oauth-config\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.673088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.673089 2550 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-console-serving-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.673088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.673100 2550 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c-oauth-serving-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:51:04.829218 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.829129 2550 generic.go:356] "Generic (PLEG): container finished" podID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" containerID="e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f" exitCode=0 Jun 16 19:51:04.829218 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.829174 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68c7f585-9xzcb" Jun 16 19:51:04.829218 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.829190 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68c7f585-9xzcb" event={"ID":"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c","Type":"ContainerDied","Data":"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f"} Jun 16 19:51:04.829451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.829228 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68c7f585-9xzcb" event={"ID":"cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c","Type":"ContainerDied","Data":"96402453c23f47af34318b4b0798874c1e4b7ea376af063d8293d467591f3f1d"} Jun 16 19:51:04.829451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.829251 2550 scope.go:117] "RemoveContainer" containerID="e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f" Jun 16 19:51:04.838069 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.838050 2550 scope.go:117] "RemoveContainer" containerID="e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f" Jun 16 19:51:04.838322 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:51:04.838299 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f\": container with ID starting with e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f not found: ID does not exist" containerID="e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f" Jun 16 19:51:04.838366 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.838330 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f"} err="failed to get container status \"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f\": rpc error: code = NotFound desc = could not find container \"e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f\": container with ID starting with e420fa886ba0c3f060e0d776880aac594acb8cdf15ce10fb40b577616146df1f not found: ID does not exist" Jun 16 19:51:04.856642 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.856617 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:51:04.859299 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:04.859277 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c68c7f585-9xzcb"] Jun 16 19:51:05.093892 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:05.093812 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" path="/var/lib/kubelet/pods/cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c/volumes" Jun 16 19:51:14.439084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:14.439048 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:24.071257 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:24.071216 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:24.531129 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:24.531093 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:34.330046 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:34.329957 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:34.430809 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:34.430773 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:34.530344 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:34.530312 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:35.066632 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:35.066575 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:35.135051 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:35.135004 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:45.572750 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:45.572701 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:45.691864 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:45.691824 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:51:45.791522 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:51:45.791463 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:27.579403 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:27.579365 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:27.679273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:27.679233 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:39.307357 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:39.307309 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:39.386607 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:39.386567 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:43.177063 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:43.177023 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:51.259562 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:51.259519 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:51.328055 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:51.328014 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:53.811165 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:53.811133 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:53.915739 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:53.915708 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:54.017912 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:54.017881 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:59.809919 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:59.809834 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:52:59.914610 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:52:59.914574 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:00.013252 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:00.013215 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:04.049174 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:04.049138 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:12.142228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:12.142192 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:17.095651 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:17.095617 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:17.187601 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:17.187547 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:37.031416 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:37.031379 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:53:37.032129 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:37.032112 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:53:37.042498 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:37.042453 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:53:37.043829 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:37.043805 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:53:37.049056 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:37.049034 2550 kubelet.go:1648] "Image garbage collection succeeded" Jun 16 19:53:43.953374 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:43.953336 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:45.731312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:45.731278 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:47.502808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:47.502768 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:47.602569 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:47.602527 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:48.959426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:48.959388 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:49.047365 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:49.047333 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:49.247735 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:49.247654 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:49.348350 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:49.348316 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:52.269770 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:52.269726 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:52.877090 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:52.877057 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:54.509234 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:54.509200 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:53:54.612496 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:53:54.612447 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:00.685316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:00.685276 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:01.447781 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:01.447743 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:01.563279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:01.563234 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:06.107830 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:06.107794 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:06.202440 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:06.202387 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:09.900695 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.900654 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-5r5tc"] Jun 16 19:54:09.901166 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901042 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" containerName="console" Jun 16 19:54:09.901166 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901058 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" containerName="console" Jun 16 19:54:09.901166 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901080 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerName="registry" Jun 16 19:54:09.901166 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901088 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerName="registry" Jun 16 19:54:09.901166 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901164 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a6f9b4-e5b7-4205-a512-b7f918d6f94f" containerName="registry" Jun 16 19:54:09.901323 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.901176 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf1844bc-8fe0-4bf0-b995-de5fd4f68b8c" containerName="console" Jun 16 19:54:09.904193 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.904172 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:09.906913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.906882 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 16 19:54:09.906913 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.906903 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 16 19:54:09.907948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.907934 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-bkmgm\"" Jun 16 19:54:09.913187 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.913156 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5r5tc"] Jun 16 19:54:09.944754 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.944722 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-bound-sa-token\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:09.944923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:09.944764 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4j65\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-kube-api-access-l4j65\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.045527 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.045489 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4j65\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-kube-api-access-l4j65\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.045685 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.045561 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-bound-sa-token\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.056162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.056126 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4j65\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-kube-api-access-l4j65\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.056316 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.056300 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac-bound-sa-token\") pod \"cert-manager-59c77684cc-5r5tc\" (UID: \"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac\") " pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.220816 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.220736 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-5r5tc" Jun 16 19:54:10.348458 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.348433 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-5r5tc"] Jun 16 19:54:10.350763 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:54:10.350741 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a69e88f_cbf1_4e4d_91da_4f2357d9f4ac.slice/crio-058e8ba898fd230ab6185b0cb490bd2b84b99dcc737d6789dafda17ae1f6220f WatchSource:0}: Error finding container 058e8ba898fd230ab6185b0cb490bd2b84b99dcc737d6789dafda17ae1f6220f: Status 404 returned error can't find the container with id 058e8ba898fd230ab6185b0cb490bd2b84b99dcc737d6789dafda17ae1f6220f Jun 16 19:54:10.352554 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.352537 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:54:10.503812 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:10.503730 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5r5tc" event={"ID":"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac","Type":"ContainerStarted","Data":"058e8ba898fd230ab6185b0cb490bd2b84b99dcc737d6789dafda17ae1f6220f"} Jun 16 19:54:11.653972 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:11.653932 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:11.761489 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:11.761369 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:13.724901 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:13.724846 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:14.523836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:14.523800 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-5r5tc" event={"ID":"4a69e88f-cbf1-4e4d-91da-4f2357d9f4ac","Type":"ContainerStarted","Data":"fcfba24ffdcded0e6d8744b88bc568da5370a884b226c9a85ae521e1ef5f2593"} Jun 16 19:54:17.968973 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:17.968938 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:18.049938 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.049885 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-5r5tc" podStartSLOduration=5.867747346 podStartE2EDuration="9.049869847s" totalImagesPullingTime="3.182122501s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:14.54472097 +0000 UTC m=+337.938713675" watchObservedRunningTime="2026-06-16 19:54:18.049869847 +0000 UTC m=+341.443862553" Jun 16 19:54:18.050086 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.050002 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j"] Jun 16 19:54:18.053302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.053281 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.056124 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.056096 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 16 19:54:18.057074 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.057056 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 16 19:54:18.057172 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.057069 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:54:18.057238 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.057201 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 16 19:54:18.057351 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.057333 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ktjb5\"" Jun 16 19:54:18.058688 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.058667 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 16 19:54:18.069229 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.069198 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j"] Jun 16 19:54:18.070576 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.070551 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:18.109020 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.108990 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-metrics-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.109183 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.109025 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.109183 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.109050 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgbn4\" (UniqueName: \"kubernetes.io/projected/1c9f32ec-21a4-43c6-9850-eb45651f5e33-kube-api-access-rgbn4\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.109183 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.109097 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c9f32ec-21a4-43c6-9850-eb45651f5e33-manager-config\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.210254 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.210219 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-metrics-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.210254 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.210254 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.210546 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.210274 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgbn4\" (UniqueName: \"kubernetes.io/projected/1c9f32ec-21a4-43c6-9850-eb45651f5e33-kube-api-access-rgbn4\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.210546 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.210300 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c9f32ec-21a4-43c6-9850-eb45651f5e33-manager-config\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.211050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.211022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/1c9f32ec-21a4-43c6-9850-eb45651f5e33-manager-config\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.212923 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.212899 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.213027 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.212899 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/1c9f32ec-21a4-43c6-9850-eb45651f5e33-metrics-cert\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.220518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.220445 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgbn4\" (UniqueName: \"kubernetes.io/projected/1c9f32ec-21a4-43c6-9850-eb45651f5e33-kube-api-access-rgbn4\") pod \"lws-controller-manager-7ff6468978-rmk2j\" (UID: \"1c9f32ec-21a4-43c6-9850-eb45651f5e33\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.362568 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.362534 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:18.494830 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.494806 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j"] Jun 16 19:54:18.497094 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:54:18.497063 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c9f32ec_21a4_43c6_9850_eb45651f5e33.slice/crio-9d1b738a8ef34bdd8db040f8138022bf0027f18db77cdf62122147b8c4a2d1c9 WatchSource:0}: Error finding container 9d1b738a8ef34bdd8db040f8138022bf0027f18db77cdf62122147b8c4a2d1c9: Status 404 returned error can't find the container with id 9d1b738a8ef34bdd8db040f8138022bf0027f18db77cdf62122147b8c4a2d1c9 Jun 16 19:54:18.538901 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:18.538867 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" event={"ID":"1c9f32ec-21a4-43c6-9850-eb45651f5e33","Type":"ContainerStarted","Data":"9d1b738a8ef34bdd8db040f8138022bf0027f18db77cdf62122147b8c4a2d1c9"} Jun 16 19:54:21.554095 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:21.554055 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" event={"ID":"1c9f32ec-21a4-43c6-9850-eb45651f5e33","Type":"ContainerStarted","Data":"0f92cd0efd0b656f3f0e8a31d3337e720babbbc02d4a55ba29af56f6e56ffda9"} Jun 16 19:54:21.554498 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:21.554141 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:21.572301 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:21.572257 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" podStartSLOduration=0.998238854 podStartE2EDuration="3.572242347s" totalImagesPullingTime="2.574003493s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:21.571851565 +0000 UTC m=+344.965844272" watchObservedRunningTime="2026-06-16 19:54:21.572242347 +0000 UTC m=+344.966235053" Jun 16 19:54:27.926001 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:27.925923 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:28.037935 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:28.037897 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:28.577007 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:28.576968 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:28.913651 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:28.913615 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.052836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.052795 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.053295 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.053041 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd"] Jun 16 19:54:29.056534 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.056513 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.059098 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.059074 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 16 19:54:29.059202 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.059110 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r9w4c\"" Jun 16 19:54:29.059202 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.059082 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 16 19:54:29.059567 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.059548 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 16 19:54:29.060242 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.060224 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 16 19:54:29.071599 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.071576 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd"] Jun 16 19:54:29.099319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.099287 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.099463 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.099350 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.099463 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.099398 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw9nt\" (UniqueName: \"kubernetes.io/projected/1e4329e7-8bac-4977-87fb-2830cf250c29-kube-api-access-xw9nt\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.099463 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.099425 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.099630 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.099460 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.191777 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.191675 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.200673 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.200650 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.200747 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.200690 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw9nt\" (UniqueName: \"kubernetes.io/projected/1e4329e7-8bac-4977-87fb-2830cf250c29-kube-api-access-xw9nt\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.200747 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.200708 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.200747 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.200742 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.200895 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.200792 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.201199 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.201174 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.202966 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.202944 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e4329e7-8bac-4977-87fb-2830cf250c29-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.203085 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.203029 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.203234 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.203215 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1e4329e7-8bac-4977-87fb-2830cf250c29-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.215524 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.215505 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw9nt\" (UniqueName: \"kubernetes.io/projected/1e4329e7-8bac-4977-87fb-2830cf250c29-kube-api-access-xw9nt\") pod \"opendatahub-operator-controller-manager-5cbd84db66-zblhd\" (UID: \"1e4329e7-8bac-4977-87fb-2830cf250c29\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.289922 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.289878 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.366628 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.366594 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:29.390906 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.390860 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.486378 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.486347 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.519684 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.519657 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd"] Jun 16 19:54:29.521890 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:54:29.521861 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e4329e7_8bac_4977_87fb_2830cf250c29.slice/crio-8f47646d85396aec47868b72f296eabc926e4e2b6c825fcdb94f5a282eeade3c WatchSource:0}: Error finding container 8f47646d85396aec47868b72f296eabc926e4e2b6c825fcdb94f5a282eeade3c: Status 404 returned error can't find the container with id 8f47646d85396aec47868b72f296eabc926e4e2b6c825fcdb94f5a282eeade3c Jun 16 19:54:29.586030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.585991 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" event={"ID":"1e4329e7-8bac-4977-87fb-2830cf250c29","Type":"ContainerStarted","Data":"8f47646d85396aec47868b72f296eabc926e4e2b6c825fcdb94f5a282eeade3c"} Jun 16 19:54:29.590326 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.590298 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.691226 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.691191 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:29.830095 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:29.830011 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:30.070784 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:30.070752 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:32.560932 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:32.560897 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-rmk2j" Jun 16 19:54:33.611663 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:33.611624 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" event={"ID":"1e4329e7-8bac-4977-87fb-2830cf250c29","Type":"ContainerStarted","Data":"b484ff83bd63c8e51d70c12c56c33cde72f3a7f0c7d51a94422247b29755874c"} Jun 16 19:54:34.193662 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:34.193574 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:34.286825 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:34.286785 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:34.617177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:34.617144 2550 generic.go:356] "Generic (PLEG): container finished" podID="1e4329e7-8bac-4977-87fb-2830cf250c29" containerID="b484ff83bd63c8e51d70c12c56c33cde72f3a7f0c7d51a94422247b29755874c" exitCode=0 Jun 16 19:54:34.617629 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:34.617223 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" event={"ID":"1e4329e7-8bac-4977-87fb-2830cf250c29","Type":"ContainerDied","Data":"b484ff83bd63c8e51d70c12c56c33cde72f3a7f0c7d51a94422247b29755874c"} Jun 16 19:54:35.623426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:35.623392 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" event={"ID":"1e4329e7-8bac-4977-87fb-2830cf250c29","Type":"ContainerStarted","Data":"6f624ed3ff7ac6c89b14e6c1505719beae2f114d9e2e0d583e4cd3137b10f5c0"} Jun 16 19:54:35.623807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:35.623516 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:35.658527 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:35.658465 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" podStartSLOduration=1.931483054 podStartE2EDuration="6.658451667s" totalImagesPullingTime="3.780160464s" totalInitContainerRuntime="946.808149ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:35.657305979 +0000 UTC m=+359.051298697" watchObservedRunningTime="2026-06-16 19:54:35.658451667 +0000 UTC m=+359.052444373" Jun 16 19:54:43.917143 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:43.917093 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:46.630199 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:46.630165 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-zblhd" Jun 16 19:54:48.297288 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:48.297252 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:48.396495 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:48.396436 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.034422 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.034388 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.137366 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.137333 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.244980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.244943 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.376292 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.376248 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.707584 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.707499 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:49.955639 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:49.955607 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:51.279119 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:51.279078 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:51.348769 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:51.348735 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:59.568341 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:59.568289 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:59.655817 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:59.655783 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:59.735071 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:59.735027 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:59.814368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:59.814318 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:54:59.929595 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:54:59.929551 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:00.022381 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:00.022339 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:00.678760 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:00.678724 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:01.027652 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:01.027570 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:01.122917 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:01.122879 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:01.207269 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:01.207236 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:12.485219 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:12.485181 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:12.582287 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:12.582252 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:14.266689 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:14.266641 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:14.393745 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:14.393693 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:14.509354 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:14.509301 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:15.129404 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:15.129355 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:15.412545 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:15.412443 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:16.391098 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.391007 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-ftctr"] Jun 16 19:55:16.394442 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.394419 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.402678 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.402655 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-zfp2n\"" Jun 16 19:55:16.403238 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.403219 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 16 19:55:16.408691 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.408669 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-ftctr"] Jun 16 19:55:16.417148 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.417108 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:16.479766 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.479733 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62tc2\" (UniqueName: \"kubernetes.io/projected/3fb82159-a6f1-427f-8023-6bc7be33a313-kube-api-access-62tc2\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.479766 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.479767 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fb82159-a6f1-427f-8023-6bc7be33a313-redirect-config\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.581042 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.581003 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62tc2\" (UniqueName: \"kubernetes.io/projected/3fb82159-a6f1-427f-8023-6bc7be33a313-kube-api-access-62tc2\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.581212 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.581049 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fb82159-a6f1-427f-8023-6bc7be33a313-redirect-config\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.581839 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.581819 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3fb82159-a6f1-427f-8023-6bc7be33a313-redirect-config\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.591150 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.591121 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62tc2\" (UniqueName: \"kubernetes.io/projected/3fb82159-a6f1-427f-8023-6bc7be33a313-kube-api-access-62tc2\") pod \"dashboard-redirect-56694dc9bd-ftctr\" (UID: \"3fb82159-a6f1-427f-8023-6bc7be33a313\") " pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.704516 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.704410 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" Jun 16 19:55:16.837996 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:16.837969 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56694dc9bd-ftctr"] Jun 16 19:55:16.840439 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:55:16.840409 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fb82159_a6f1_427f_8023_6bc7be33a313.slice/crio-baa1397d66cda9ac9217e3a689a088bc83350092975bcb99dd8441f915cc2584 WatchSource:0}: Error finding container baa1397d66cda9ac9217e3a689a088bc83350092975bcb99dd8441f915cc2584: Status 404 returned error can't find the container with id baa1397d66cda9ac9217e3a689a088bc83350092975bcb99dd8441f915cc2584 Jun 16 19:55:17.799960 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:17.799898 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" event={"ID":"3fb82159-a6f1-427f-8023-6bc7be33a313","Type":"ContainerStarted","Data":"baa1397d66cda9ac9217e3a689a088bc83350092975bcb99dd8441f915cc2584"} Jun 16 19:55:21.820207 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:21.820171 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" event={"ID":"3fb82159-a6f1-427f-8023-6bc7be33a313","Type":"ContainerStarted","Data":"86ebb6972e7b323a36ab49ae7ea8ee84ae3e3c4b8de54ec6e603d7dfc20f5f70"} Jun 16 19:55:24.954869 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:24.954812 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:25.132321 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:25.132281 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:25.852391 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:25.852355 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:25.925011 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:25.924977 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:26.598860 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:26.598812 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:27.587438 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:27.587396 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:29.512948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.512905 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:29.616216 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.616179 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:29.835774 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.835681 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56694dc9bd-ftctr" podStartSLOduration=9.375196577 podStartE2EDuration="13.835663318s" totalImagesPullingTime="4.460466741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:21.842350358 +0000 UTC m=+405.236343075" watchObservedRunningTime="2026-06-16 19:55:29.835663318 +0000 UTC m=+413.229656024" Jun 16 19:55:29.835917 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.835801 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt"] Jun 16 19:55:29.839115 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.839098 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.841639 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.841615 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-cxptw\"" Jun 16 19:55:29.841895 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.841880 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 16 19:55:29.860821 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.860799 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt"] Jun 16 19:55:29.875140 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.875106 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:29.881028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.880999 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881036 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881128 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881063 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881209 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881142 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881209 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881192 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881211 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9lgb\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-kube-api-access-v9lgb\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881240 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881256 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d45911-372a-4191-925e-a7913fae3e3b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.881378 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.881300 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d45911-372a-4191-925e-a7913fae3e3b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.979504 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.979429 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:29.982519 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982498 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982599 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982543 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982599 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982562 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9lgb\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-kube-api-access-v9lgb\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982599 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982589 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982607 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d45911-372a-4191-925e-a7913fae3e3b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982623 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d45911-372a-4191-925e-a7913fae3e3b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982654 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982673 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982982 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982920 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.982982 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.982954 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.983134 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.983111 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.983200 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.983121 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.983200 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.983197 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.983502 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.983455 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c5d45911-372a-4191-925e-a7913fae3e3b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.985055 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.985032 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c5d45911-372a-4191-925e-a7913fae3e3b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:29.985228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:29.985212 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c5d45911-372a-4191-925e-a7913fae3e3b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:30.000573 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.000552 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9lgb\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-kube-api-access-v9lgb\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:30.003191 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.003173 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c5d45911-372a-4191-925e-a7913fae3e3b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f97958v2tt\" (UID: \"c5d45911-372a-4191-925e-a7913fae3e3b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:30.150039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.150001 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:30.173888 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.173851 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:30.291483 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.291450 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt"] Jun 16 19:55:30.293180 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:55:30.293152 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5d45911_372a_4191_925e_a7913fae3e3b.slice/crio-37af2faf72c188dc9b986196c155183f43308a357815e45117afc6bd85120de7 WatchSource:0}: Error finding container 37af2faf72c188dc9b986196c155183f43308a357815e45117afc6bd85120de7: Status 404 returned error can't find the container with id 37af2faf72c188dc9b986196c155183f43308a357815e45117afc6bd85120de7 Jun 16 19:55:30.693280 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.693238 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:30.857946 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:30.857911 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" event={"ID":"c5d45911-372a-4191-925e-a7913fae3e3b","Type":"ContainerStarted","Data":"37af2faf72c188dc9b986196c155183f43308a357815e45117afc6bd85120de7"} Jun 16 19:55:32.852820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:32.852780 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:55:32.853130 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:32.852852 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:55:32.853130 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:32.852892 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:55:33.872686 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:33.872652 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" event={"ID":"c5d45911-372a-4191-925e-a7913fae3e3b","Type":"ContainerStarted","Data":"f215cfdcbccd761b2c8e6acbbb5f37b925abcc4510166c9d353302ab45d9d30a"} Jun 16 19:55:33.901695 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:33.901644 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" podStartSLOduration=2.344179315 podStartE2EDuration="4.901629055s" totalImagesPullingTime="2.55744974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:33.900194095 +0000 UTC m=+417.294186800" watchObservedRunningTime="2026-06-16 19:55:33.901629055 +0000 UTC m=+417.295621830" Jun 16 19:55:34.151177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:34.151087 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:34.155722 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:34.155698 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:34.877318 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:34.877288 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:34.878158 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:34.878137 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f97958v2tt" Jun 16 19:55:49.841145 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:49.841110 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:49.955167 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:49.955128 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:50.023379 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.023339 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:50.029991 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.029972 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:50.033198 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.033176 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 16 19:55:50.034312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.034291 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-zmhnt\"" Jun 16 19:55:50.040416 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.040398 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 16 19:55:50.043195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.043170 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:50.065439 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.065409 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:55:50.153269 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.153233 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btv4d\" (UniqueName: \"kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d\") pod \"kuadrant-operator-catalog-2bbfn\" (UID: \"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4\") " pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:50.253962 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.253927 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btv4d\" (UniqueName: \"kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d\") pod \"kuadrant-operator-catalog-2bbfn\" (UID: \"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4\") " pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:50.264449 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.264420 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-btv4d\" (UniqueName: \"kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d\") pod \"kuadrant-operator-catalog-2bbfn\" (UID: \"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4\") " pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:50.337142 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.337105 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:50.337396 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.337382 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:50.466604 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.466576 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:50.468204 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:55:50.468181 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0a108e_f6d8_4d6e_b0a0_ecd514f0f6c4.slice/crio-c0a544847a7994c26146da689ac06fb1c4021501eb9d57f3c93526f3425cea8c WatchSource:0}: Error finding container c0a544847a7994c26146da689ac06fb1c4021501eb9d57f3c93526f3425cea8c: Status 404 returned error can't find the container with id c0a544847a7994c26146da689ac06fb1c4021501eb9d57f3c93526f3425cea8c Jun 16 19:55:50.548246 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.548211 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mx9b"] Jun 16 19:55:50.552718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.552702 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:55:50.561835 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.561808 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mx9b"] Jun 16 19:55:50.657430 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.657391 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lvdz\" (UniqueName: \"kubernetes.io/projected/2d7488ea-bbfb-43f1-befd-ddf9b301a4e5-kube-api-access-8lvdz\") pod \"kuadrant-operator-catalog-4mx9b\" (UID: \"2d7488ea-bbfb-43f1-befd-ddf9b301a4e5\") " pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:55:50.757961 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.757875 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lvdz\" (UniqueName: \"kubernetes.io/projected/2d7488ea-bbfb-43f1-befd-ddf9b301a4e5-kube-api-access-8lvdz\") pod \"kuadrant-operator-catalog-4mx9b\" (UID: \"2d7488ea-bbfb-43f1-befd-ddf9b301a4e5\") " pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:55:50.768741 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.768720 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lvdz\" (UniqueName: \"kubernetes.io/projected/2d7488ea-bbfb-43f1-befd-ddf9b301a4e5-kube-api-access-8lvdz\") pod \"kuadrant-operator-catalog-4mx9b\" (UID: \"2d7488ea-bbfb-43f1-befd-ddf9b301a4e5\") " pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:55:50.862561 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.862524 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:55:50.947573 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.947533 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" event={"ID":"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4","Type":"ContainerStarted","Data":"c0a544847a7994c26146da689ac06fb1c4021501eb9d57f3c93526f3425cea8c"} Jun 16 19:55:50.994971 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:50.994943 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4mx9b"] Jun 16 19:55:50.997232 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:55:50.997202 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7488ea_bbfb_43f1_befd_ddf9b301a4e5.slice/crio-4d22c292d22b82863f4393fe35339a538da99c79c8566b8371201e89dc19ea4e WatchSource:0}: Error finding container 4d22c292d22b82863f4393fe35339a538da99c79c8566b8371201e89dc19ea4e: Status 404 returned error can't find the container with id 4d22c292d22b82863f4393fe35339a538da99c79c8566b8371201e89dc19ea4e Jun 16 19:55:51.953837 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:51.953796 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" event={"ID":"2d7488ea-bbfb-43f1-befd-ddf9b301a4e5","Type":"ContainerStarted","Data":"4d22c292d22b82863f4393fe35339a538da99c79c8566b8371201e89dc19ea4e"} Jun 16 19:55:53.970044 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:53.970002 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" event={"ID":"2d7488ea-bbfb-43f1-befd-ddf9b301a4e5","Type":"ContainerStarted","Data":"493cbc249a8680dd3fc8d3d8048427db7964b85a3c1c5775c42b4b77b418009b"} Jun 16 19:55:53.971568 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:53.971538 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" event={"ID":"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4","Type":"ContainerStarted","Data":"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea"} Jun 16 19:55:53.971695 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:53.971612 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" podUID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" containerName="registry-server" containerID="cri-o://73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea" gracePeriod=2 Jun 16 19:55:53.990070 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:53.990026 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" podStartSLOduration=1.882829265 podStartE2EDuration="3.990011896s" totalImagesPullingTime="2.107182631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:53.98846004 +0000 UTC m=+437.382452746" watchObservedRunningTime="2026-06-16 19:55:53.990011896 +0000 UTC m=+437.384004601" Jun 16 19:55:54.006456 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.006411 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" podStartSLOduration=2.3560438599999998 podStartE2EDuration="5.006396964s" totalImagesPullingTime="2.650353104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:55:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:54.005267704 +0000 UTC m=+437.399260412" watchObservedRunningTime="2026-06-16 19:55:54.006396964 +0000 UTC m=+437.400389692" Jun 16 19:55:54.279619 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.279585 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:54.389084 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.389047 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-btv4d\" (UniqueName: \"kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d\") pod \"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4\" (UID: \"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4\") " Jun 16 19:55:54.391240 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.391206 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d" (OuterVolumeSpecName: "kube-api-access-btv4d") pod "5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" (UID: "5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4"). InnerVolumeSpecName "kube-api-access-btv4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:55:54.490664 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.490584 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-btv4d\" (UniqueName: \"kubernetes.io/projected/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4-kube-api-access-btv4d\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:55:54.976643 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.976605 2550 generic.go:356] "Generic (PLEG): container finished" podID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" containerID="73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea" exitCode=0 Jun 16 19:55:54.976643 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.976648 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" Jun 16 19:55:54.977124 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.976690 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" event={"ID":"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4","Type":"ContainerDied","Data":"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea"} Jun 16 19:55:54.977124 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.976744 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-2bbfn" event={"ID":"5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4","Type":"ContainerDied","Data":"c0a544847a7994c26146da689ac06fb1c4021501eb9d57f3c93526f3425cea8c"} Jun 16 19:55:54.977124 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.976765 2550 scope.go:117] "RemoveContainer" containerID="73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea" Jun 16 19:55:54.985868 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.985847 2550 scope.go:117] "RemoveContainer" containerID="73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea" Jun 16 19:55:54.986130 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:55:54.986109 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea\": container with ID starting with 73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea not found: ID does not exist" containerID="73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea" Jun 16 19:55:54.986175 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:54.986141 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea"} err="failed to get container status \"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea\": rpc error: code = NotFound desc = could not find container \"73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea\": container with ID starting with 73135e25ed98cade145816449fc3541bb1c218f9ae5d9660fcb8c07616309aea not found: ID does not exist" Jun 16 19:55:55.000842 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:55.000818 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:55.006040 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:55.006019 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-2bbfn"] Jun 16 19:55:55.094387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:55:55.094353 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" path="/var/lib/kubelet/pods/5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4/volumes" Jun 16 19:56:00.863007 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:00.862974 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:56:00.863399 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:00.863026 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:56:00.884979 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:00.884946 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:56:01.022892 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:01.022863 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4mx9b" Jun 16 19:56:19.150611 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:19.150562 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:21.377410 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.377376 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb"] Jun 16 19:56:21.377813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.377721 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" containerName="registry-server" Jun 16 19:56:21.377813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.377733 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" containerName="registry-server" Jun 16 19:56:21.377813 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.377786 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e0a108e-f6d8-4d6e-b0a0-ecd514f0f6c4" containerName="registry-server" Jun 16 19:56:21.380824 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.380807 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:21.383324 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.383304 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9fmvq\"" Jun 16 19:56:21.390379 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.390354 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb"] Jun 16 19:56:21.403779 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.403753 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cps5c\" (UniqueName: \"kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c\") pod \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" (UID: \"afeccf4a-f6d9-445c-b841-0eb1237aebf1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:21.504788 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.504752 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cps5c\" (UniqueName: \"kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c\") pod \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" (UID: \"afeccf4a-f6d9-445c-b841-0eb1237aebf1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:21.520090 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.520057 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cps5c\" (UniqueName: \"kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c\") pod \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" (UID: \"afeccf4a-f6d9-445c-b841-0eb1237aebf1\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:21.692194 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.692101 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:21.826118 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:21.826082 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb"] Jun 16 19:56:21.829048 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:21.829022 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafeccf4a_f6d9_445c_b841_0eb1237aebf1.slice/crio-4392d1d84ea67f3808aebccd9e313ec0ad29f61d97639afb993324168327144b WatchSource:0}: Error finding container 4392d1d84ea67f3808aebccd9e313ec0ad29f61d97639afb993324168327144b: Status 404 returned error can't find the container with id 4392d1d84ea67f3808aebccd9e313ec0ad29f61d97639afb993324168327144b Jun 16 19:56:22.093212 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:22.093116 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" event={"ID":"afeccf4a-f6d9-445c-b841-0eb1237aebf1","Type":"ContainerStarted","Data":"4392d1d84ea67f3808aebccd9e313ec0ad29f61d97639afb993324168327144b"} Jun 16 19:56:22.341187 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:22.341152 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:22.454331 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:22.454292 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:24.102815 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:24.102782 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" event={"ID":"afeccf4a-f6d9-445c-b841-0eb1237aebf1","Type":"ContainerStarted","Data":"4c5f6d56891ebd72c2278be88aac0231454c38d009f01a973de23cedc334e6bc"} Jun 16 19:56:24.103228 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:24.102885 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:24.120797 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:24.120752 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" podStartSLOduration=1.001594454 podStartE2EDuration="3.120738187s" totalImagesPullingTime="2.119143733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:24.120370021 +0000 UTC m=+467.514362744" watchObservedRunningTime="2026-06-16 19:56:24.120738187 +0000 UTC m=+467.514730893" Jun 16 19:56:25.625662 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:25.625623 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:26.741989 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.741955 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2"] Jun 16 19:56:26.747732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.747714 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.750387 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.750360 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x7c9f\"" Jun 16 19:56:26.758195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.758174 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2"] Jun 16 19:56:26.848604 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.848570 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.848783 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.848615 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lplbl\" (UniqueName: \"kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.949150 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.949114 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.949351 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.949162 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lplbl\" (UniqueName: \"kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.949605 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.949581 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:26.962030 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:26.962001 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lplbl\" (UniqueName: \"kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:27.057967 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:27.057894 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:27.198821 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:27.198793 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2"] Jun 16 19:56:27.201970 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:27.201937 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942d55ad_43c2_4679_9c4c_dc80e4f8d598.slice/crio-5585895764b3d057e17d40f9dea36a522af1116d867450723d4ea87e7d1c8359 WatchSource:0}: Error finding container 5585895764b3d057e17d40f9dea36a522af1116d867450723d4ea87e7d1c8359: Status 404 returned error can't find the container with id 5585895764b3d057e17d40f9dea36a522af1116d867450723d4ea87e7d1c8359 Jun 16 19:56:27.752668 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:27.752633 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:28.076634 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:28.076552 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:28.124059 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:28.124023 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" event={"ID":"942d55ad-43c2-4679-9c4c-dc80e4f8d598","Type":"ContainerStarted","Data":"5585895764b3d057e17d40f9dea36a522af1116d867450723d4ea87e7d1c8359"} Jun 16 19:56:30.351568 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:30.351534 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:30.611149 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:30.611036 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:30.743936 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:30.743900 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:33.006762 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:33.006721 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:33.109244 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:33.109212 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:34.777745 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.777670 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d55ff96b-dqk6s"] Jun 16 19:56:34.781337 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.781315 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.785984 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.785951 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 16 19:56:34.786233 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.786206 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 16 19:56:34.786613 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.786595 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 16 19:56:34.786931 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.786914 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 16 19:56:34.787271 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.787255 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 16 19:56:34.787449 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.787427 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-4rflm\"" Jun 16 19:56:34.787626 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.787281 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 16 19:56:34.788691 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.788640 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 16 19:56:34.793790 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.793770 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 16 19:56:34.794112 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.794083 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d55ff96b-dqk6s"] Jun 16 19:56:34.811592 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811569 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-trusted-ca-bundle\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811693 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811605 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-oauth-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811693 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811648 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqhrr\" (UniqueName: \"kubernetes.io/projected/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-kube-api-access-gqhrr\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811693 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811679 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-service-ca\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811712 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811745 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.811836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.811779 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-oauth-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.854966 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.854929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:34.912434 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912396 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqhrr\" (UniqueName: \"kubernetes.io/projected/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-kube-api-access-gqhrr\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912434 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912433 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-service-ca\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912452 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912496 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912524 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-oauth-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912546 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-trusted-ca-bundle\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.912692 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.912570 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-oauth-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.913294 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.913268 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-service-ca\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.913789 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.913765 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.913901 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.913810 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-oauth-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.914297 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.914274 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-trusted-ca-bundle\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.915305 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.915282 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-serving-cert\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.915418 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.915404 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-console-oauth-config\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.924723 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.924703 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqhrr\" (UniqueName: \"kubernetes.io/projected/f99bed43-3d1f-4d4e-a355-2eb06bec5c60-kube-api-access-gqhrr\") pod \"console-75d55ff96b-dqk6s\" (UID: \"f99bed43-3d1f-4d4e-a355-2eb06bec5c60\") " pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:34.957930 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:34.957892 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:35.057656 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.057564 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:35.098638 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.098602 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:35.109565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.109541 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:35.160817 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.160711 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" event={"ID":"942d55ad-43c2-4679-9c4c-dc80e4f8d598","Type":"ContainerStarted","Data":"4d63cd613591790be6f6a41ef6054d0870d1f7fdf484cb7c68f6cf48f3bc4bf1"} Jun 16 19:56:35.160952 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.160940 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:35.186868 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.186811 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" podStartSLOduration=2.009098643 podStartE2EDuration="9.186789668s" totalImagesPullingTime="7.177691025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:35.184991532 +0000 UTC m=+478.578984239" watchObservedRunningTime="2026-06-16 19:56:35.186789668 +0000 UTC m=+478.580782377" Jun 16 19:56:35.255359 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:35.255333 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d55ff96b-dqk6s"] Jun 16 19:56:35.258056 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:35.258025 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf99bed43_3d1f_4d4e_a355_2eb06bec5c60.slice/crio-20cdfb447b8584c78c5ec14710c98cd730b646217d004da3d32cf486a9de0dc8 WatchSource:0}: Error finding container 20cdfb447b8584c78c5ec14710c98cd730b646217d004da3d32cf486a9de0dc8: Status 404 returned error can't find the container with id 20cdfb447b8584c78c5ec14710c98cd730b646217d004da3d32cf486a9de0dc8 Jun 16 19:56:36.166785 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:36.166740 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d55ff96b-dqk6s" event={"ID":"f99bed43-3d1f-4d4e-a355-2eb06bec5c60","Type":"ContainerStarted","Data":"2dcbaaca5e6153f4d6f0aede24fbc84e77284f60bd186c99b5cf91e4b4f9c670"} Jun 16 19:56:36.167188 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:36.166809 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d55ff96b-dqk6s" event={"ID":"f99bed43-3d1f-4d4e-a355-2eb06bec5c60","Type":"ContainerStarted","Data":"20cdfb447b8584c78c5ec14710c98cd730b646217d004da3d32cf486a9de0dc8"} Jun 16 19:56:36.189297 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:36.189253 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d55ff96b-dqk6s" podStartSLOduration=2.189237291 podStartE2EDuration="2.189237291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:36.188907975 +0000 UTC m=+479.582900682" watchObservedRunningTime="2026-06-16 19:56:36.189237291 +0000 UTC m=+479.583229997" Jun 16 19:56:37.226328 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:37.226295 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:37.469736 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:37.469702 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:38.335708 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:38.335668 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:38.439395 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:38.439366 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:44.434674 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:44.434632 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:44.534853 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:44.534818 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:45.099532 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.099499 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:45.099703 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.099554 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:45.104248 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.104223 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:45.211742 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.211716 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-75d55ff96b-dqk6s" Jun 16 19:56:45.431147 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.431112 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:45.529910 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.529875 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:45.630796 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:45.630755 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:46.169295 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:46.169260 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:47.446645 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.446613 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:47.451131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.451114 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.465118 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.465094 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:47.526160 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.526126 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78m5f\" (UniqueName: \"kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.526160 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.526163 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.627410 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.627373 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78m5f\" (UniqueName: \"kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.627410 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.627415 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.627837 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.627815 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.640352 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.640324 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78m5f\" (UniqueName: \"kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.650919 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.650892 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:47.651173 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.651157 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:47.681576 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.681545 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r"] Jun 16 19:56:47.685137 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.685119 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.696136 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.696109 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r"] Jun 16 19:56:47.789907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.789881 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:47.792845 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:47.792816 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ab70b7_11dc_4d40_a8ba_cc03251c741b.slice/crio-3c69b68868eae7ac87a2795be6de1d115bd756ced3d2dcdb79804504c7af19d5 WatchSource:0}: Error finding container 3c69b68868eae7ac87a2795be6de1d115bd756ced3d2dcdb79804504c7af19d5: Status 404 returned error can't find the container with id 3c69b68868eae7ac87a2795be6de1d115bd756ced3d2dcdb79804504c7af19d5 Jun 16 19:56:47.829440 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.829416 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.829556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.829447 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7g8m8\" (UniqueName: \"kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.930942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.930892 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.930942 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.930936 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7g8m8\" (UniqueName: \"kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.931417 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.931391 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.949577 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.949551 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7g8m8\" (UniqueName: \"kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8\") pod \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:47.997603 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:47.997522 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:48.026371 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.026342 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r"] Jun 16 19:56:48.036092 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.036053 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r"] Jun 16 19:56:48.059031 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.058983 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:48.060597 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.060571 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:56:48.065123 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.065101 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.066508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.066485 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9"] Jun 16 19:56:48.073705 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.073682 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:56:48.082158 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.082135 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2"] Jun 16 19:56:48.082315 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.082295 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" containerName="manager" containerID="cri-o://4d63cd613591790be6f6a41ef6054d0870d1f7fdf484cb7c68f6cf48f3bc4bf1" gracePeriod=2 Jun 16 19:56:48.095209 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.095172 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2"] Jun 16 19:56:48.104602 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.104578 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb"] Jun 16 19:56:48.104827 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.104798 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" containerName="manager" containerID="cri-o://4c5f6d56891ebd72c2278be88aac0231454c38d009f01a973de23cedc334e6bc" gracePeriod=2 Jun 16 19:56:48.106840 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.106805 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.114382 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114321 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:56:48.114878 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114858 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" containerName="manager" Jun 16 19:56:48.114935 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114883 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" containerName="manager" Jun 16 19:56:48.114935 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114896 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" containerName="manager" Jun 16 19:56:48.114935 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114905 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" containerName="manager" Jun 16 19:56:48.115039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.114987 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" containerName="manager" Jun 16 19:56:48.115039 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.115003 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" containerName="manager" Jun 16 19:56:48.119824 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.119800 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb"] Jun 16 19:56:48.119937 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.119902 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.131447 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.131421 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:56:48.132034 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.132010 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96w4\" (UniqueName: \"kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.132171 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.132146 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.156994 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.156958 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.158950 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.158928 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.225149 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.225100 2550 generic.go:356] "Generic (PLEG): container finished" podID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" containerID="4c5f6d56891ebd72c2278be88aac0231454c38d009f01a973de23cedc334e6bc" exitCode=0 Jun 16 19:56:48.227368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.227268 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" containerName="manager" containerID="cri-o://da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f" gracePeriod=10 Jun 16 19:56:48.229444 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.229422 2550 generic.go:356] "Generic (PLEG): container finished" podID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" containerID="4d63cd613591790be6f6a41ef6054d0870d1f7fdf484cb7c68f6cf48f3bc4bf1" exitCode=0 Jun 16 19:56:48.229667 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.229483 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.231617 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.231579 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:48.232667 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.232643 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjnrs\" (UniqueName: \"kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.232739 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.232705 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v96w4\" (UniqueName: \"kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.232779 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.232746 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.233253 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.232783 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.233253 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.233211 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.233881 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.233584 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.243169 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.243145 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96w4\" (UniqueName: \"kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4\") pod \"kuadrant-operator-controller-manager-55467d9f7-6t6dn\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.264588 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.264518 2550 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ab70b7_11dc_4d40_a8ba_cc03251c741b.slice/crio-da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ab70b7_11dc_4d40_a8ba_cc03251c741b.slice/crio-conmon-da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f.scope\": RecentStats: unable to find data in memory cache]" Jun 16 19:56:48.333438 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.333402 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.333652 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.333510 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjnrs\" (UniqueName: \"kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.333775 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.333754 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.344701 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.344677 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.346139 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.346116 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjnrs\" (UniqueName: \"kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-drjmn\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.349090 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.349055 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.351164 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.351134 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:48.353118 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.353088 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.353347 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.353329 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.355221 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.355195 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.357069 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.357046 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.360297 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.360274 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:48.376296 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.376268 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:48.434049 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.434024 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lplbl\" (UniqueName: \"kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl\") pod \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " Jun 16 19:56:48.434152 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.434084 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cps5c\" (UniqueName: \"kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c\") pod \"afeccf4a-f6d9-445c-b841-0eb1237aebf1\" (UID: \"afeccf4a-f6d9-445c-b841-0eb1237aebf1\") " Jun 16 19:56:48.434152 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.434109 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume\") pod \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\" (UID: \"942d55ad-43c2-4679-9c4c-dc80e4f8d598\") " Jun 16 19:56:48.434859 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.434807 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "942d55ad-43c2-4679-9c4c-dc80e4f8d598" (UID: "942d55ad-43c2-4679-9c4c-dc80e4f8d598"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:48.438932 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.438896 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl" (OuterVolumeSpecName: "kube-api-access-lplbl") pod "942d55ad-43c2-4679-9c4c-dc80e4f8d598" (UID: "942d55ad-43c2-4679-9c4c-dc80e4f8d598"). InnerVolumeSpecName "kube-api-access-lplbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:48.438932 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.438911 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c" (OuterVolumeSpecName: "kube-api-access-cps5c") pod "afeccf4a-f6d9-445c-b841-0eb1237aebf1" (UID: "afeccf4a-f6d9-445c-b841-0eb1237aebf1"). InnerVolumeSpecName "kube-api-access-cps5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:48.463060 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.463035 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:48.468253 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.468224 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-rbpgb\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:48.472373 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.472345 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:48.476183 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.476152 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-l9qc2\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:48.504990 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.504968 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:48.517293 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.517267 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:56:48.524131 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:48.524103 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8723c5_7858_4cbf_b7c6_a750d1d8b890.slice/crio-cbe9aac0214cbe5aad6c7a47777efeae62f4022aa22ef446f3a996a62b714a8b WatchSource:0}: Error finding container cbe9aac0214cbe5aad6c7a47777efeae62f4022aa22ef446f3a996a62b714a8b: Status 404 returned error can't find the container with id cbe9aac0214cbe5aad6c7a47777efeae62f4022aa22ef446f3a996a62b714a8b Jun 16 19:56:48.534534 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534514 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume\") pod \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " Jun 16 19:56:48.534621 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534602 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78m5f\" (UniqueName: \"kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f\") pod \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\" (UID: \"15ab70b7-11dc-4d40-a8ba-cc03251c741b\") " Jun 16 19:56:48.534779 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534767 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lplbl\" (UniqueName: \"kubernetes.io/projected/942d55ad-43c2-4679-9c4c-dc80e4f8d598-kube-api-access-lplbl\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:48.534820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534782 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cps5c\" (UniqueName: \"kubernetes.io/projected/afeccf4a-f6d9-445c-b841-0eb1237aebf1-kube-api-access-cps5c\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:48.534820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534796 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/942d55ad-43c2-4679-9c4c-dc80e4f8d598-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:48.534820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.534787 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15ab70b7-11dc-4d40-a8ba-cc03251c741b" (UID: "15ab70b7-11dc-4d40-a8ba-cc03251c741b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:48.536584 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.536562 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f" (OuterVolumeSpecName: "kube-api-access-78m5f") pod "15ab70b7-11dc-4d40-a8ba-cc03251c741b" (UID: "15ab70b7-11dc-4d40-a8ba-cc03251c741b"). InnerVolumeSpecName "kube-api-access-78m5f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:48.635518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.635492 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78m5f\" (UniqueName: \"kubernetes.io/projected/15ab70b7-11dc-4d40-a8ba-cc03251c741b-kube-api-access-78m5f\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:48.635518 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.635520 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15ab70b7-11dc-4d40-a8ba-cc03251c741b-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:48.646400 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:48.646371 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:56:48.649999 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:56:48.649975 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92fa29b5_cee3_48c7_aed9_4fe704825687.slice/crio-bc1936c9fc332ad34a4ca71f204a2fcb3cc3423cad4d54d981fc9d4e14e7c677 WatchSource:0}: Error finding container bc1936c9fc332ad34a4ca71f204a2fcb3cc3423cad4d54d981fc9d4e14e7c677: Status 404 returned error can't find the container with id bc1936c9fc332ad34a4ca71f204a2fcb3cc3423cad4d54d981fc9d4e14e7c677 Jun 16 19:56:48.990087 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.990054 2550 log.go:32] "RunPodSandbox from runtime service failed" err=< Jun 16 19:56:48.990087 ip-10-0-138-253 kubenswrapper[2550]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gsr4r_kuadrant-system_77de554c-425c-4b8d-92a4-aa6ffcf94ffb_0(56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gsr4r to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e" Netns:"/var/run/netns/9f0c36ab-69b4-467d-a91a-818ad825e661" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gsr4r;K8S_POD_INFRA_CONTAINER_ID=56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e;K8S_POD_UID=77de554c-425c-4b8d-92a4-aa6ffcf94ffb" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r/77de554c-425c-4b8d-92a4-aa6ffcf94ffb:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r 56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r 56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-gsr4r" not found Jun 16 19:56:48.990087 ip-10-0-138-253 kubenswrapper[2550]: ' Jun 16 19:56:48.990087 ip-10-0-138-253 kubenswrapper[2550]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 16 19:56:48.990087 ip-10-0-138-253 kubenswrapper[2550]: > Jun 16 19:56:48.990265 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:48.990114 2550 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=< Jun 16 19:56:48.990265 ip-10-0-138-253 kubenswrapper[2550]: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-gsr4r_kuadrant-system_77de554c-425c-4b8d-92a4-aa6ffcf94ffb_0(56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-gsr4r to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e" Netns:"/var/run/netns/9f0c36ab-69b4-467d-a91a-818ad825e661" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-gsr4r;K8S_POD_INFRA_CONTAINER_ID=56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e;K8S_POD_UID=77de554c-425c-4b8d-92a4-aa6ffcf94ffb" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r] networking: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r/77de554c-425c-4b8d-92a4-aa6ffcf94ffb:ovn-kubernetes]: error adding container to network "ovn-kubernetes": CNI request failed with status 400: '[kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r 56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e network default NAD default NAD key ] [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r 56d9a9591aaeb66c7c4dd9c6b3199eeb6dac7425a6883fd810623d3ddfbee42e network default NAD default NAD key ] failed to get pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r: timed out waiting for pod after 1s: pods "kuadrant-operator-controller-manager-55467d9f7-gsr4r" not found Jun 16 19:56:48.990265 ip-10-0-138-253 kubenswrapper[2550]: ' Jun 16 19:56:48.990265 ip-10-0-138-253 kubenswrapper[2550]: ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"} Jun 16 19:56:48.990265 ip-10-0-138-253 kubenswrapper[2550]: > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:49.096789 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.096743 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" path="/var/lib/kubelet/pods/15ab70b7-11dc-4d40-a8ba-cc03251c741b/volumes" Jun 16 19:56:49.097465 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.097442 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="942d55ad-43c2-4679-9c4c-dc80e4f8d598" path="/var/lib/kubelet/pods/942d55ad-43c2-4679-9c4c-dc80e4f8d598/volumes" Jun 16 19:56:49.097960 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.097939 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" path="/var/lib/kubelet/pods/afeccf4a-f6d9-445c-b841-0eb1237aebf1/volumes" Jun 16 19:56:49.238687 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.238588 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" event={"ID":"0d8723c5-7858-4cbf-b7c6-a750d1d8b890","Type":"ContainerStarted","Data":"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0"} Jun 16 19:56:49.238687 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.238658 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:56:49.238687 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.238683 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" event={"ID":"0d8723c5-7858-4cbf-b7c6-a750d1d8b890","Type":"ContainerStarted","Data":"cbe9aac0214cbe5aad6c7a47777efeae62f4022aa22ef446f3a996a62b714a8b"} Jun 16 19:56:49.239915 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.239892 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-rbpgb" Jun 16 19:56:49.240059 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.239929 2550 scope.go:117] "RemoveContainer" containerID="4c5f6d56891ebd72c2278be88aac0231454c38d009f01a973de23cedc334e6bc" Jun 16 19:56:49.241514 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.241490 2550 generic.go:356] "Generic (PLEG): container finished" podID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" containerID="da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f" exitCode=2 Jun 16 19:56:49.241625 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.241527 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:49.243154 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.243131 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-l9qc2" Jun 16 19:56:49.245020 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.244993 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:49.245125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.245013 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" event={"ID":"92fa29b5-cee3-48c7-aed9-4fe704825687","Type":"ContainerStarted","Data":"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd"} Jun 16 19:56:49.245125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.245061 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" event={"ID":"92fa29b5-cee3-48c7-aed9-4fe704825687","Type":"ContainerStarted","Data":"bc1936c9fc332ad34a4ca71f204a2fcb3cc3423cad4d54d981fc9d4e14e7c677"} Jun 16 19:56:49.245125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.245093 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:56:49.250086 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.250067 2550 scope.go:117] "RemoveContainer" containerID="da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f" Jun 16 19:56:49.253508 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.253489 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:49.259369 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.259353 2550 scope.go:117] "RemoveContainer" containerID="da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f" Jun 16 19:56:49.259647 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:49.259631 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f\": container with ID starting with da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f not found: ID does not exist" containerID="da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f" Jun 16 19:56:49.259714 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.259655 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f"} err="failed to get container status \"da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f\": rpc error: code = NotFound desc = could not find container \"da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f\": container with ID starting with da752b2ee03aea8358965ff4e4d6967d7969d3191191392649246fe8e4f76e0f not found: ID does not exist" Jun 16 19:56:49.259714 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.259671 2550 scope.go:117] "RemoveContainer" containerID="4d63cd613591790be6f6a41ef6054d0870d1f7fdf484cb7c68f6cf48f3bc4bf1" Jun 16 19:56:49.263681 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.263643 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" podStartSLOduration=1.26363215 podStartE2EDuration="1.26363215s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:49.261924489 +0000 UTC m=+492.655917228" watchObservedRunningTime="2026-06-16 19:56:49.26363215 +0000 UTC m=+492.657624856" Jun 16 19:56:49.263842 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:49.263818 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:49.287373 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.287333 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" podStartSLOduration=1.28732116 podStartE2EDuration="1.28732116s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:56:49.285741172 +0000 UTC m=+492.679733900" watchObservedRunningTime="2026-06-16 19:56:49.28732116 +0000 UTC m=+492.681313866" Jun 16 19:56:49.287634 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:49.287606 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="77de554c-425c-4b8d-92a4-aa6ffcf94ffb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:49.343559 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.343525 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume\") pod \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " Jun 16 19:56:49.343681 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.343578 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7g8m8\" (UniqueName: \"kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8\") pod \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\" (UID: \"77de554c-425c-4b8d-92a4-aa6ffcf94ffb\") " Jun 16 19:56:49.343773 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.343751 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77de554c-425c-4b8d-92a4-aa6ffcf94ffb" (UID: "77de554c-425c-4b8d-92a4-aa6ffcf94ffb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:56:49.345718 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.345689 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8" (OuterVolumeSpecName: "kube-api-access-7g8m8") pod "77de554c-425c-4b8d-92a4-aa6ffcf94ffb" (UID: "77de554c-425c-4b8d-92a4-aa6ffcf94ffb"). InnerVolumeSpecName "kube-api-access-7g8m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:56:49.444582 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.444551 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:49.444582 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:49.444576 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7g8m8\" (UniqueName: \"kubernetes.io/projected/77de554c-425c-4b8d-92a4-aa6ffcf94ffb-kube-api-access-7g8m8\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:56:50.254673 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:50.254633 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:50.257209 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:50.257174 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="77de554c-425c-4b8d-92a4-aa6ffcf94ffb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:50.259299 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:50.259267 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:50.263000 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:50.262972 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-f8xt9\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="15ab70b7-11dc-4d40-a8ba-cc03251c741b" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-f8xt9" Jun 16 19:56:50.265175 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:56:50.265149 2550 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-gsr4r\" is forbidden: User \"system:node:ip-10-0-138-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-253.ec2.internal' and this object" podUID="77de554c-425c-4b8d-92a4-aa6ffcf94ffb" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-gsr4r" Jun 16 19:56:50.955771 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:50.955736 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:51.055594 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:51.055546 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:51.096598 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:51.096569 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77de554c-425c-4b8d-92a4-aa6ffcf94ffb" path="/var/lib/kubelet/pods/77de554c-425c-4b8d-92a4-aa6ffcf94ffb/volumes" Jun 16 19:56:51.156177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:51.156140 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:53.584826 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:53.584784 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:53.682811 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:53.682772 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:56.563884 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:56.563845 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:56:56.663811 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:56:56.663774 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:00.256373 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.256342 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:57:00.256802 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.256411 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:57:00.326093 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.326057 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:57:00.326279 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.326254 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" podUID="92fa29b5-cee3-48c7-aed9-4fe704825687" containerName="manager" containerID="cri-o://1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd" gracePeriod=10 Jun 16 19:57:00.581899 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.581875 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:57:00.607765 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.607732 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 19:57:00.608201 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608178 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" containerName="manager" Jun 16 19:57:00.608201 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608204 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" containerName="manager" Jun 16 19:57:00.608346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608233 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92fa29b5-cee3-48c7-aed9-4fe704825687" containerName="manager" Jun 16 19:57:00.608346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608242 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="92fa29b5-cee3-48c7-aed9-4fe704825687" containerName="manager" Jun 16 19:57:00.608346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608322 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="92fa29b5-cee3-48c7-aed9-4fe704825687" containerName="manager" Jun 16 19:57:00.608346 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.608333 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="afeccf4a-f6d9-445c-b841-0eb1237aebf1" containerName="manager" Jun 16 19:57:00.613661 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.613642 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.624768 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.624742 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 19:57:00.738973 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.738942 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume\") pod \"92fa29b5-cee3-48c7-aed9-4fe704825687\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " Jun 16 19:57:00.739125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.738982 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjnrs\" (UniqueName: \"kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs\") pod \"92fa29b5-cee3-48c7-aed9-4fe704825687\" (UID: \"92fa29b5-cee3-48c7-aed9-4fe704825687\") " Jun 16 19:57:00.739125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.739087 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.739125 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.739109 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwdcm\" (UniqueName: \"kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.739356 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.739334 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "92fa29b5-cee3-48c7-aed9-4fe704825687" (UID: "92fa29b5-cee3-48c7-aed9-4fe704825687"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:57:00.741072 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.741042 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs" (OuterVolumeSpecName: "kube-api-access-sjnrs") pod "92fa29b5-cee3-48c7-aed9-4fe704825687" (UID: "92fa29b5-cee3-48c7-aed9-4fe704825687"). InnerVolumeSpecName "kube-api-access-sjnrs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:57:00.840262 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.840193 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.840262 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.840227 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwdcm\" (UniqueName: \"kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.840421 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.840269 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/92fa29b5-cee3-48c7-aed9-4fe704825687-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:00.840421 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.840349 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjnrs\" (UniqueName: \"kubernetes.io/projected/92fa29b5-cee3-48c7-aed9-4fe704825687-kube-api-access-sjnrs\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:00.840575 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.840558 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.850505 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.850463 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwdcm\" (UniqueName: \"kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm\") pod \"kuadrant-operator-controller-manager-86878c769f-w52jl\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:00.926582 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:00.926551 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:01.073029 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.072997 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 19:57:01.073202 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:57:01.073166 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeffc64bc_6d47_490a_904e_a440d6180802.slice/crio-87ca99c30acc2bb2e655d75b37035323840f63f735159660478ac736284446bf WatchSource:0}: Error finding container 87ca99c30acc2bb2e655d75b37035323840f63f735159660478ac736284446bf: Status 404 returned error can't find the container with id 87ca99c30acc2bb2e655d75b37035323840f63f735159660478ac736284446bf Jun 16 19:57:01.307094 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.307058 2550 generic.go:356] "Generic (PLEG): container finished" podID="92fa29b5-cee3-48c7-aed9-4fe704825687" containerID="1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd" exitCode=0 Jun 16 19:57:01.307565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.307101 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" Jun 16 19:57:01.307565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.307148 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" event={"ID":"92fa29b5-cee3-48c7-aed9-4fe704825687","Type":"ContainerDied","Data":"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd"} Jun 16 19:57:01.307565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.307201 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn" event={"ID":"92fa29b5-cee3-48c7-aed9-4fe704825687","Type":"ContainerDied","Data":"bc1936c9fc332ad34a4ca71f204a2fcb3cc3423cad4d54d981fc9d4e14e7c677"} Jun 16 19:57:01.307565 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.307233 2550 scope.go:117] "RemoveContainer" containerID="1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd" Jun 16 19:57:01.309088 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.309061 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" event={"ID":"effc64bc-6d47-490a-904e-a440d6180802","Type":"ContainerStarted","Data":"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07"} Jun 16 19:57:01.309214 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.309115 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" event={"ID":"effc64bc-6d47-490a-904e-a440d6180802","Type":"ContainerStarted","Data":"87ca99c30acc2bb2e655d75b37035323840f63f735159660478ac736284446bf"} Jun 16 19:57:01.309214 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.309147 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:01.315909 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.315888 2550 scope.go:117] "RemoveContainer" containerID="1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd" Jun 16 19:57:01.316163 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:57:01.316146 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd\": container with ID starting with 1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd not found: ID does not exist" containerID="1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd" Jun 16 19:57:01.316218 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.316171 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd"} err="failed to get container status \"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd\": rpc error: code = NotFound desc = could not find container \"1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd\": container with ID starting with 1f034be5ee2dc0a24b00404cb2bea43236091d866901cabc6096c98a6e125bbd not found: ID does not exist" Jun 16 19:57:01.329501 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.329458 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:57:01.336184 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.336139 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-drjmn"] Jun 16 19:57:01.354311 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:01.354267 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" podStartSLOduration=1.3542524249999999 podStartE2EDuration="1.354252425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:01.353520093 +0000 UTC m=+504.747512798" watchObservedRunningTime="2026-06-16 19:57:01.354252425 +0000 UTC m=+504.748245130" Jun 16 19:57:03.094861 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:03.094831 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92fa29b5-cee3-48c7-aed9-4fe704825687" path="/var/lib/kubelet/pods/92fa29b5-cee3-48c7-aed9-4fe704825687/volumes" Jun 16 19:57:03.476145 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:03.476110 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:03.578522 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:03.578460 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:09.989055 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:09.988996 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:10.112907 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:10.112872 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:12.317253 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.317221 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 19:57:12.375482 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.375431 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:57:12.375744 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.375710 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" podUID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" containerName="manager" containerID="cri-o://9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0" gracePeriod=10 Jun 16 19:57:12.635008 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.634973 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:57:12.731956 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.731924 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v96w4\" (UniqueName: \"kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4\") pod \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " Jun 16 19:57:12.732134 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.731988 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume\") pod \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\" (UID: \"0d8723c5-7858-4cbf-b7c6-a750d1d8b890\") " Jun 16 19:57:12.732390 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.732354 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0d8723c5-7858-4cbf-b7c6-a750d1d8b890" (UID: "0d8723c5-7858-4cbf-b7c6-a750d1d8b890"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:57:12.734041 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.734019 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4" (OuterVolumeSpecName: "kube-api-access-v96w4") pod "0d8723c5-7858-4cbf-b7c6-a750d1d8b890" (UID: "0d8723c5-7858-4cbf-b7c6-a750d1d8b890"). InnerVolumeSpecName "kube-api-access-v96w4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:57:12.832842 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.832807 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v96w4\" (UniqueName: \"kubernetes.io/projected/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-kube-api-access-v96w4\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:12.832842 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:12.832837 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d8723c5-7858-4cbf-b7c6-a750d1d8b890-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:13.369267 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.369233 2550 generic.go:356] "Generic (PLEG): container finished" podID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" containerID="9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0" exitCode=0 Jun 16 19:57:13.369783 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.369279 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" Jun 16 19:57:13.369783 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.369319 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" event={"ID":"0d8723c5-7858-4cbf-b7c6-a750d1d8b890","Type":"ContainerDied","Data":"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0"} Jun 16 19:57:13.369783 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.369373 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn" event={"ID":"0d8723c5-7858-4cbf-b7c6-a750d1d8b890","Type":"ContainerDied","Data":"cbe9aac0214cbe5aad6c7a47777efeae62f4022aa22ef446f3a996a62b714a8b"} Jun 16 19:57:13.369783 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.369396 2550 scope.go:117] "RemoveContainer" containerID="9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0" Jun 16 19:57:13.378197 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.378033 2550 scope.go:117] "RemoveContainer" containerID="9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0" Jun 16 19:57:13.378303 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:57:13.378281 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0\": container with ID starting with 9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0 not found: ID does not exist" containerID="9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0" Jun 16 19:57:13.378341 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.378311 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0"} err="failed to get container status \"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0\": rpc error: code = NotFound desc = could not find container \"9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0\": container with ID starting with 9c56af14905e4bfe6483408bbfa930ab7eade73fcc39fe10e71c0e3179f33cb0 not found: ID does not exist" Jun 16 19:57:13.392068 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.392044 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:57:13.400914 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:13.400891 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-6t6dn"] Jun 16 19:57:15.094882 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:15.094845 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" path="/var/lib/kubelet/pods/0d8723c5-7858-4cbf-b7c6-a750d1d8b890/volumes" Jun 16 19:57:16.647145 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.647110 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq"] Jun 16 19:57:16.647537 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.647426 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" containerName="manager" Jun 16 19:57:16.647537 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.647436 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" containerName="manager" Jun 16 19:57:16.647537 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.647514 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d8723c5-7858-4cbf-b7c6-a750d1d8b890" containerName="manager" Jun 16 19:57:16.652677 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.652658 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.655051 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.655030 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6zxd8\"" Jun 16 19:57:16.659283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659086 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659127 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659158 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659186 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659283 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659226 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659563 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659317 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659563 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659365 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659563 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659384 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcxc5\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-kube-api-access-zcxc5\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.659563 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.659460 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.662757 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.662735 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq"] Jun 16 19:57:16.693229 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.693190 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:16.760290 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760255 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760290 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760294 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcxc5\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-kube-api-access-zcxc5\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760345 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760373 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760393 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760411 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760461 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760537 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760852 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760576 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760852 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760799 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.760968 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760926 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.761025 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.760969 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.761119 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.761099 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.761162 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.761133 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.762871 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.762842 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.763133 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.763117 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.769607 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.769579 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.769689 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.769667 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcxc5\" (UniqueName: \"kubernetes.io/projected/eb5d4452-f6b8-45d6-8574-11c75db1faaa-kube-api-access-zcxc5\") pod \"maas-default-gateway-openshift-default-687ff6996-sfnlq\" (UID: \"eb5d4452-f6b8-45d6-8574-11c75db1faaa\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:16.963461 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:16.963381 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:17.067330 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.067286 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:17.117585 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.117557 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq"] Jun 16 19:57:17.119037 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:57:17.119000 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5d4452_f6b8_45d6_8574_11c75db1faaa.slice/crio-d96392d90a65f9b456ddb88230cabdb7c93b26081796b61ee433808b1fd1e8e5 WatchSource:0}: Error finding container d96392d90a65f9b456ddb88230cabdb7c93b26081796b61ee433808b1fd1e8e5: Status 404 returned error can't find the container with id d96392d90a65f9b456ddb88230cabdb7c93b26081796b61ee433808b1fd1e8e5 Jun 16 19:57:17.121080 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.121049 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:57:17.121138 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.121113 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:57:17.121177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.121139 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:57:17.392459 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.392420 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" event={"ID":"eb5d4452-f6b8-45d6-8574-11c75db1faaa","Type":"ContainerStarted","Data":"12a124b634485be100dcde2b78eb094a5d385b15f6a3969b679d447e7d360022"} Jun 16 19:57:17.392648 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.392516 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" event={"ID":"eb5d4452-f6b8-45d6-8574-11c75db1faaa","Type":"ContainerStarted","Data":"d96392d90a65f9b456ddb88230cabdb7c93b26081796b61ee433808b1fd1e8e5"} Jun 16 19:57:17.432911 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.432859 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" podStartSLOduration=1.432841535 podStartE2EDuration="1.432841535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:17.431341311 +0000 UTC m=+520.825334018" watchObservedRunningTime="2026-06-16 19:57:17.432841535 +0000 UTC m=+520.826834240" Jun 16 19:57:17.964431 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.964396 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:17.997446 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:17.997395 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:18.124987 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:18.124948 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:18.968749 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:18.968720 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:19.401826 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:19.401792 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:19.402830 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:19.402808 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 19:57:32.424405 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.424318 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:32.427716 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.427696 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.430165 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.430139 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 16 19:57:32.430165 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.430162 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pgnj\"" Jun 16 19:57:32.438878 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.438851 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:32.455451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.455417 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:32.487098 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.487055 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.487302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.487129 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlkbg\" (UniqueName: \"kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.516751 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.516713 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:32.555354 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.555321 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:32.588189 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.588149 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.588189 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.588193 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlkbg\" (UniqueName: \"kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.588815 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.588794 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.597399 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.597373 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlkbg\" (UniqueName: \"kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg\") pod \"limitador-limitador-64c94fd64f-r2xcx\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.657535 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.657496 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:32.745771 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.745680 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:32.879997 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:32.879966 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:32.883705 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:57:32.883669 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa85d98_7dbb_4462_8ab3_3c0dbc93d4bc.slice/crio-ebae0e5fdfeff8987a3ac854cf17d566c3deceb2cbbc80d14c167b178f94611e WatchSource:0}: Error finding container ebae0e5fdfeff8987a3ac854cf17d566c3deceb2cbbc80d14c167b178f94611e: Status 404 returned error can't find the container with id ebae0e5fdfeff8987a3ac854cf17d566c3deceb2cbbc80d14c167b178f94611e Jun 16 19:57:33.263499 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.263454 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:33.268049 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.268026 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:33.270855 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.270831 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-c5bw5\"" Jun 16 19:57:33.274217 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.274193 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:33.292837 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.292810 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2b5c\" (UniqueName: \"kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c\") pod \"authorino-58cd955675-9h2mr\" (UID: \"017bc21a-1eb6-462e-b71c-71cb2ddd1e51\") " pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:33.308429 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.308401 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:33.393730 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.393696 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2b5c\" (UniqueName: \"kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c\") pod \"authorino-58cd955675-9h2mr\" (UID: \"017bc21a-1eb6-462e-b71c-71cb2ddd1e51\") " pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:33.403957 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.403925 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2b5c\" (UniqueName: \"kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c\") pod \"authorino-58cd955675-9h2mr\" (UID: \"017bc21a-1eb6-462e-b71c-71cb2ddd1e51\") " pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:33.405820 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.405793 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:57:33.431062 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.431031 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:57:33.434420 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.434403 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:57:33.440273 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.440248 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:57:33.467277 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.467241 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" event={"ID":"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc","Type":"ContainerStarted","Data":"ebae0e5fdfeff8987a3ac854cf17d566c3deceb2cbbc80d14c167b178f94611e"} Jun 16 19:57:33.494909 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.494877 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h69mc\" (UniqueName: \"kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc\") pod \"authorino-75d556bd77-9fmh6\" (UID: \"e27041fc-1ac9-402c-9e4c-212926bd06c6\") " pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:57:33.578556 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.578459 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:33.595657 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.595628 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h69mc\" (UniqueName: \"kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc\") pod \"authorino-75d556bd77-9fmh6\" (UID: \"e27041fc-1ac9-402c-9e4c-212926bd06c6\") " pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:57:33.606021 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.605963 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h69mc\" (UniqueName: \"kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc\") pod \"authorino-75d556bd77-9fmh6\" (UID: \"e27041fc-1ac9-402c-9e4c-212926bd06c6\") " pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:57:33.731268 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.731230 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:33.735951 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:57:33.735910 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod017bc21a_1eb6_462e_b71c_71cb2ddd1e51.slice/crio-0bf2e9083e5121b4861cd3c58e8dd5b89eb704db4dbe78f3026e29897abb31d1 WatchSource:0}: Error finding container 0bf2e9083e5121b4861cd3c58e8dd5b89eb704db4dbe78f3026e29897abb31d1: Status 404 returned error can't find the container with id 0bf2e9083e5121b4861cd3c58e8dd5b89eb704db4dbe78f3026e29897abb31d1 Jun 16 19:57:33.744432 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.744407 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:57:33.928836 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:33.926913 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:57:33.931283 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:57:33.931251 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode27041fc_1ac9_402c_9e4c_212926bd06c6.slice/crio-cc79c408bd89f8d93882ba388ece5ebfab086cf0e8bfa940e0ce9c4663476e28 WatchSource:0}: Error finding container cc79c408bd89f8d93882ba388ece5ebfab086cf0e8bfa940e0ce9c4663476e28: Status 404 returned error can't find the container with id cc79c408bd89f8d93882ba388ece5ebfab086cf0e8bfa940e0ce9c4663476e28 Jun 16 19:57:34.474520 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:34.474464 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9h2mr" event={"ID":"017bc21a-1eb6-462e-b71c-71cb2ddd1e51","Type":"ContainerStarted","Data":"0bf2e9083e5121b4861cd3c58e8dd5b89eb704db4dbe78f3026e29897abb31d1"} Jun 16 19:57:34.475926 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:34.475895 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9fmh6" event={"ID":"e27041fc-1ac9-402c-9e4c-212926bd06c6","Type":"ContainerStarted","Data":"cc79c408bd89f8d93882ba388ece5ebfab086cf0e8bfa940e0ce9c4663476e28"} Jun 16 19:57:38.499818 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.499776 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9fmh6" event={"ID":"e27041fc-1ac9-402c-9e4c-212926bd06c6","Type":"ContainerStarted","Data":"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d"} Jun 16 19:57:38.501530 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.501507 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9h2mr" event={"ID":"017bc21a-1eb6-462e-b71c-71cb2ddd1e51","Type":"ContainerStarted","Data":"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2"} Jun 16 19:57:38.502945 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.502920 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" event={"ID":"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc","Type":"ContainerStarted","Data":"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec"} Jun 16 19:57:38.503016 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.502972 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:38.517493 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.517428 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9fmh6" podStartSLOduration=1.7941731189999999 podStartE2EDuration="5.517415219s" totalImagesPullingTime="3.7232421s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:38.516827336 +0000 UTC m=+541.910820043" watchObservedRunningTime="2026-06-16 19:57:38.517415219 +0000 UTC m=+541.911407924" Jun 16 19:57:38.534729 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.534681 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" podStartSLOduration=1.767790371 podStartE2EDuration="6.534666631s" totalImagesPullingTime="4.76687626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:38.534076981 +0000 UTC m=+541.928069687" watchObservedRunningTime="2026-06-16 19:57:38.534666631 +0000 UTC m=+541.928659357" Jun 16 19:57:38.548392 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.548361 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:38.559925 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:38.559878 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-9h2mr" podStartSLOduration=1.646073825 podStartE2EDuration="5.559863528s" totalImagesPullingTime="3.913789703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:38.558734995 +0000 UTC m=+541.952727702" watchObservedRunningTime="2026-06-16 19:57:38.559863528 +0000 UTC m=+541.953856234" Jun 16 19:57:40.511775 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:40.511727 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-9h2mr" podUID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" containerName="authorino" containerID="cri-o://12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2" gracePeriod=30 Jun 16 19:57:40.765864 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:40.765799 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:40.863005 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:40.862974 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2b5c\" (UniqueName: \"kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c\") pod \"017bc21a-1eb6-462e-b71c-71cb2ddd1e51\" (UID: \"017bc21a-1eb6-462e-b71c-71cb2ddd1e51\") " Jun 16 19:57:40.865120 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:40.865080 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c" (OuterVolumeSpecName: "kube-api-access-d2b5c") pod "017bc21a-1eb6-462e-b71c-71cb2ddd1e51" (UID: "017bc21a-1eb6-462e-b71c-71cb2ddd1e51"). InnerVolumeSpecName "kube-api-access-d2b5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:57:40.963901 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:40.963856 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2b5c\" (UniqueName: \"kubernetes.io/projected/017bc21a-1eb6-462e-b71c-71cb2ddd1e51-kube-api-access-d2b5c\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:41.518181 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.518144 2550 generic.go:356] "Generic (PLEG): container finished" podID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" containerID="12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2" exitCode=0 Jun 16 19:57:41.518181 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.518181 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-9h2mr" Jun 16 19:57:41.518681 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.518228 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9h2mr" event={"ID":"017bc21a-1eb6-462e-b71c-71cb2ddd1e51","Type":"ContainerDied","Data":"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2"} Jun 16 19:57:41.518681 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.518269 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-9h2mr" event={"ID":"017bc21a-1eb6-462e-b71c-71cb2ddd1e51","Type":"ContainerDied","Data":"0bf2e9083e5121b4861cd3c58e8dd5b89eb704db4dbe78f3026e29897abb31d1"} Jun 16 19:57:41.518681 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.518287 2550 scope.go:117] "RemoveContainer" containerID="12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2" Jun 16 19:57:41.526558 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.526537 2550 scope.go:117] "RemoveContainer" containerID="12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2" Jun 16 19:57:41.526810 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:57:41.526791 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2\": container with ID starting with 12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2 not found: ID does not exist" containerID="12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2" Jun 16 19:57:41.526856 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.526817 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2"} err="failed to get container status \"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2\": rpc error: code = NotFound desc = could not find container \"12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2\": container with ID starting with 12fb26cfc13c66b3917ef23dcd8bce0bc5316a5930aca20f56aa44addbab7aa2 not found: ID does not exist" Jun 16 19:57:41.536289 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.536265 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:41.540867 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:41.540847 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-9h2mr"] Jun 16 19:57:43.095724 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:43.095685 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" path="/var/lib/kubelet/pods/017bc21a-1eb6-462e-b71c-71cb2ddd1e51/volumes" Jun 16 19:57:47.365109 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:47.365069 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:47.365600 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:47.365284 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" podUID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" containerName="limitador" containerID="cri-o://fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec" gracePeriod=30 Jun 16 19:57:47.366359 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:47.366337 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:47.919058 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:47.919031 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:48.026022 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.025926 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlkbg\" (UniqueName: \"kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg\") pod \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " Jun 16 19:57:48.026022 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.025968 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file\") pod \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\" (UID: \"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc\") " Jun 16 19:57:48.026378 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.026348 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file" (OuterVolumeSpecName: "config-file") pod "aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" (UID: "aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:57:48.028052 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.028026 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg" (OuterVolumeSpecName: "kube-api-access-dlkbg") pod "aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" (UID: "aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc"). InnerVolumeSpecName "kube-api-access-dlkbg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:57:48.126808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.126768 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlkbg\" (UniqueName: \"kubernetes.io/projected/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-kube-api-access-dlkbg\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:48.126808 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.126803 2550 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc-config-file\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:57:48.552761 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.552727 2550 generic.go:356] "Generic (PLEG): container finished" podID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" containerID="fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec" exitCode=0 Jun 16 19:57:48.553195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.552769 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" Jun 16 19:57:48.553195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.552811 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" event={"ID":"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc","Type":"ContainerDied","Data":"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec"} Jun 16 19:57:48.553195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.552862 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xcx" event={"ID":"aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc","Type":"ContainerDied","Data":"ebae0e5fdfeff8987a3ac854cf17d566c3deceb2cbbc80d14c167b178f94611e"} Jun 16 19:57:48.553195 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.552886 2550 scope.go:117] "RemoveContainer" containerID="fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec" Jun 16 19:57:48.561424 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.561405 2550 scope.go:117] "RemoveContainer" containerID="fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec" Jun 16 19:57:48.561687 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:57:48.561670 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec\": container with ID starting with fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec not found: ID does not exist" containerID="fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec" Jun 16 19:57:48.561755 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.561694 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec"} err="failed to get container status \"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec\": rpc error: code = NotFound desc = could not find container \"fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec\": container with ID starting with fcf57b3308593c536c0275ea9fc7e20f99381082c913c49689f1cfd60fbfadec not found: ID does not exist" Jun 16 19:57:48.575715 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.575688 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:48.581302 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:48.581274 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xcx"] Jun 16 19:57:49.094544 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:57:49.094512 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" path="/var/lib/kubelet/pods/aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc/volumes" Jun 16 19:58:01.651594 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651556 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-57cjr"] Jun 16 19:58:01.651980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651879 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" containerName="authorino" Jun 16 19:58:01.651980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651890 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" containerName="authorino" Jun 16 19:58:01.651980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651902 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" containerName="limitador" Jun 16 19:58:01.651980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651910 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" containerName="limitador" Jun 16 19:58:01.652111 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651987 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa85d98-7dbb-4462-8ab3-3c0dbc93d4bc" containerName="limitador" Jun 16 19:58:01.652111 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.651997 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="017bc21a-1eb6-462e-b71c-71cb2ddd1e51" containerName="authorino" Jun 16 19:58:01.655090 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.655075 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.657663 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.657640 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 16 19:58:01.665555 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.665533 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-57cjr"] Jun 16 19:58:01.750373 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.750344 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fd89f09-58a6-4d15-901e-d098dcebd787-data\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.750569 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.750391 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6zc2\" (UniqueName: \"kubernetes.io/projected/4fd89f09-58a6-4d15-901e-d098dcebd787-kube-api-access-v6zc2\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.851502 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.851452 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fd89f09-58a6-4d15-901e-d098dcebd787-data\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.851674 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.851522 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6zc2\" (UniqueName: \"kubernetes.io/projected/4fd89f09-58a6-4d15-901e-d098dcebd787-kube-api-access-v6zc2\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.851839 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.851818 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/4fd89f09-58a6-4d15-901e-d098dcebd787-data\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.862026 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.862005 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6zc2\" (UniqueName: \"kubernetes.io/projected/4fd89f09-58a6-4d15-901e-d098dcebd787-kube-api-access-v6zc2\") pod \"postgres-69fb4594cf-57cjr\" (UID: \"4fd89f09-58a6-4d15-901e-d098dcebd787\") " pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:01.865755 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.865729 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:01.965319 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:01.965232 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:02.094951 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:02.094875 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-57cjr"] Jun 16 19:58:02.097187 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:58:02.097157 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fd89f09_58a6_4d15_901e_d098dcebd787.slice/crio-15098ddd3eeee00b65d9ccf50fa73474eb1afb3924fb0e243f5a8aabf71f9607 WatchSource:0}: Error finding container 15098ddd3eeee00b65d9ccf50fa73474eb1afb3924fb0e243f5a8aabf71f9607: Status 404 returned error can't find the container with id 15098ddd3eeee00b65d9ccf50fa73474eb1afb3924fb0e243f5a8aabf71f9607 Jun 16 19:58:02.617058 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:02.617010 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-57cjr" event={"ID":"4fd89f09-58a6-4d15-901e-d098dcebd787","Type":"ContainerStarted","Data":"15098ddd3eeee00b65d9ccf50fa73474eb1afb3924fb0e243f5a8aabf71f9607"} Jun 16 19:58:04.628498 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:04.628448 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-57cjr" event={"ID":"4fd89f09-58a6-4d15-901e-d098dcebd787","Type":"ContainerStarted","Data":"bcb45a44bc02b77a120540640b522a7b480d35f22eddfb257964a3abffe22a12"} Jun 16 19:58:04.628866 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:04.628606 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:04.647393 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:04.647344 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-57cjr" podStartSLOduration=1.453617583 podStartE2EDuration="3.64733107s" totalImagesPullingTime="2.193713487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:58:04.645728365 +0000 UTC m=+568.039721073" watchObservedRunningTime="2026-06-16 19:58:04.64733107 +0000 UTC m=+568.041323776" Jun 16 19:58:10.661760 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:10.661730 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-57cjr" Jun 16 19:58:12.635708 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:12.635671 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:12.797028 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:12.796990 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:14.383861 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:14.383814 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:20.017194 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:20.017155 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:20.116927 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:20.116890 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:24.426737 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.426696 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2d7xz"] Jun 16 19:58:24.431426 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.431407 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" Jun 16 19:58:24.434177 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.434154 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 16 19:58:24.434312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.434288 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-bl7zc\"" Jun 16 19:58:24.434312 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.434301 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 16 19:58:24.442917 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.442897 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2d7xz"] Jun 16 19:58:24.548368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.548338 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7p9j\" (UniqueName: \"kubernetes.io/projected/18a0dbb4-a3c3-48a2-acd5-6d7c5951582b-kube-api-access-x7p9j\") pod \"keycloak-operator-d67dbbb48-2d7xz\" (UID: \"18a0dbb4-a3c3-48a2-acd5-6d7c5951582b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" Jun 16 19:58:24.649186 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.649147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7p9j\" (UniqueName: \"kubernetes.io/projected/18a0dbb4-a3c3-48a2-acd5-6d7c5951582b-kube-api-access-x7p9j\") pod \"keycloak-operator-d67dbbb48-2d7xz\" (UID: \"18a0dbb4-a3c3-48a2-acd5-6d7c5951582b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" Jun 16 19:58:24.658824 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.658795 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7p9j\" (UniqueName: \"kubernetes.io/projected/18a0dbb4-a3c3-48a2-acd5-6d7c5951582b-kube-api-access-x7p9j\") pod \"keycloak-operator-d67dbbb48-2d7xz\" (UID: \"18a0dbb4-a3c3-48a2-acd5-6d7c5951582b\") " pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" Jun 16 19:58:24.742422 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.742330 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" Jun 16 19:58:24.875439 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:24.875411 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-2d7xz"] Jun 16 19:58:24.880323 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:58:24.878612 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18a0dbb4_a3c3_48a2_acd5_6d7c5951582b.slice/crio-341ef731be21515851a381d141060957c1dcc46740c53e3d067ed3e9e9496533 WatchSource:0}: Error finding container 341ef731be21515851a381d141060957c1dcc46740c53e3d067ed3e9e9496533: Status 404 returned error can't find the container with id 341ef731be21515851a381d141060957c1dcc46740c53e3d067ed3e9e9496533 Jun 16 19:58:25.724844 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:25.724807 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" event={"ID":"18a0dbb4-a3c3-48a2-acd5-6d7c5951582b","Type":"ContainerStarted","Data":"341ef731be21515851a381d141060957c1dcc46740c53e3d067ed3e9e9496533"} Jun 16 19:58:31.757424 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:31.757374 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" event={"ID":"18a0dbb4-a3c3-48a2-acd5-6d7c5951582b","Type":"ContainerStarted","Data":"ccb469bb679263f06d852e2876bde323d3fdea0bb5d3e84e11e8ab20a8e2a628"} Jun 16 19:58:31.774948 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:31.774887 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-2d7xz" podStartSLOduration=1.036299708 podStartE2EDuration="7.774868574s" totalImagesPullingTime="6.738568866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:58:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:58:31.774273071 +0000 UTC m=+595.168265806" watchObservedRunningTime="2026-06-16 19:58:31.774868574 +0000 UTC m=+595.168861279" Jun 16 19:58:37.070376 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:37.070345 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:58:37.070376 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:37.070365 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 19:58:37.074154 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:37.074133 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:58:37.074322 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:37.074168 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 19:58:41.118459 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:41.118417 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:58:41.215973 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:58:41.215929 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:10.623831 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.623735 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:10.818862 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.818830 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:10.822081 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.822064 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:10.830107 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.830084 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:10.859422 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.859389 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xv8j\" (UniqueName: \"kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j\") pod \"authorino-5d4b67c446-sc8v6\" (UID: \"5b6460b3-2802-42dd-a607-f3006461fb8f\") " pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:10.960660 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.960565 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xv8j\" (UniqueName: \"kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j\") pod \"authorino-5d4b67c446-sc8v6\" (UID: \"5b6460b3-2802-42dd-a607-f3006461fb8f\") " pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:10.974807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:10.974771 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xv8j\" (UniqueName: \"kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j\") pod \"authorino-5d4b67c446-sc8v6\" (UID: \"5b6460b3-2802-42dd-a607-f3006461fb8f\") " pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:11.055787 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.055752 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:11.056026 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.056013 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:11.096901 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.096872 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:11.100732 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.100708 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:11.107142 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.107120 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:11.162269 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.162232 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlqd7\" (UniqueName: \"kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7\") pod \"authorino-5c64fcd5f6-v95g5\" (UID: \"976d6025-574a-4925-a057-4e847fc8c164\") " pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:11.198842 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.198811 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:11.202183 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:59:11.202152 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b6460b3_2802_42dd_a607_f3006461fb8f.slice/crio-10d2267d8a3e1d413b28919a8d3656155404aa28c6b024502612446a5e9bc988 WatchSource:0}: Error finding container 10d2267d8a3e1d413b28919a8d3656155404aa28c6b024502612446a5e9bc988: Status 404 returned error can't find the container with id 10d2267d8a3e1d413b28919a8d3656155404aa28c6b024502612446a5e9bc988 Jun 16 19:59:11.203851 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.203834 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:59:11.262947 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.262870 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlqd7\" (UniqueName: \"kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7\") pod \"authorino-5c64fcd5f6-v95g5\" (UID: \"976d6025-574a-4925-a057-4e847fc8c164\") " pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:11.272017 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.271980 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlqd7\" (UniqueName: \"kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7\") pod \"authorino-5c64fcd5f6-v95g5\" (UID: \"976d6025-574a-4925-a057-4e847fc8c164\") " pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:11.412134 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.412095 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:11.437762 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.437729 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:11.471340 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.471308 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 19:59:11.475506 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.475461 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.478006 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.477982 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 16 19:59:11.484691 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.484667 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 19:59:11.554370 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.554341 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:11.555819 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:59:11.555799 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod976d6025_574a_4925_a057_4e847fc8c164.slice/crio-307b253def0a51415fc416e40a2c0c0cbb8e3fd7b94c0b0cffc9ce6baafdeab0 WatchSource:0}: Error finding container 307b253def0a51415fc416e40a2c0c0cbb8e3fd7b94c0b0cffc9ce6baafdeab0: Status 404 returned error can't find the container with id 307b253def0a51415fc416e40a2c0c0cbb8e3fd7b94c0b0cffc9ce6baafdeab0 Jun 16 19:59:11.565807 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.565785 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x85hn\" (UniqueName: \"kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.565906 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.565848 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.667003 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.666963 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.667392 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.667026 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x85hn\" (UniqueName: \"kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.669412 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.669386 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.675794 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.675770 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x85hn\" (UniqueName: \"kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn\") pod \"authorino-67f695b7cb-f5fp2\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.711329 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.711292 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:11.786034 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.786008 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 19:59:11.933632 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.933604 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 19:59:11.935695 ip-10-0-138-253 kubenswrapper[2550]: W0616 19:59:11.935667 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podddebfe6a_047f_4738_8a50_2e0ab77de461.slice/crio-8711c86ff51331015b088237cd4b890f43d27131c6af2759a06342a2d390676d WatchSource:0}: Error finding container 8711c86ff51331015b088237cd4b890f43d27131c6af2759a06342a2d390676d: Status 404 returned error can't find the container with id 8711c86ff51331015b088237cd4b890f43d27131c6af2759a06342a2d390676d Jun 16 19:59:11.942118 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.942079 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" event={"ID":"ddebfe6a-047f-4738-8a50-2e0ab77de461","Type":"ContainerStarted","Data":"8711c86ff51331015b088237cd4b890f43d27131c6af2759a06342a2d390676d"} Jun 16 19:59:11.943240 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.943221 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" event={"ID":"976d6025-574a-4925-a057-4e847fc8c164","Type":"ContainerStarted","Data":"307b253def0a51415fc416e40a2c0c0cbb8e3fd7b94c0b0cffc9ce6baafdeab0"} Jun 16 19:59:11.944368 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.944349 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" event={"ID":"5b6460b3-2802-42dd-a607-f3006461fb8f","Type":"ContainerStarted","Data":"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72"} Jun 16 19:59:11.944460 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.944381 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" event={"ID":"5b6460b3-2802-42dd-a607-f3006461fb8f","Type":"ContainerStarted","Data":"10d2267d8a3e1d413b28919a8d3656155404aa28c6b024502612446a5e9bc988"} Jun 16 19:59:11.944460 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.944433 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" podUID="5b6460b3-2802-42dd-a607-f3006461fb8f" containerName="authorino" containerID="cri-o://5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72" gracePeriod=30 Jun 16 19:59:11.959702 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:11.959582 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" podStartSLOduration=1.463164147 podStartE2EDuration="1.959562008s" totalImagesPullingTime="496.397861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:11.959325777 +0000 UTC m=+635.353318486" watchObservedRunningTime="2026-06-16 19:59:11.959562008 +0000 UTC m=+635.353554707" Jun 16 19:59:12.207010 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.206980 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:12.270793 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.270763 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xv8j\" (UniqueName: \"kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j\") pod \"5b6460b3-2802-42dd-a607-f3006461fb8f\" (UID: \"5b6460b3-2802-42dd-a607-f3006461fb8f\") " Jun 16 19:59:12.272980 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.272946 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j" (OuterVolumeSpecName: "kube-api-access-2xv8j") pod "5b6460b3-2802-42dd-a607-f3006461fb8f" (UID: "5b6460b3-2802-42dd-a607-f3006461fb8f"). InnerVolumeSpecName "kube-api-access-2xv8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:59:12.371829 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.371800 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xv8j\" (UniqueName: \"kubernetes.io/projected/5b6460b3-2802-42dd-a607-f3006461fb8f-kube-api-access-2xv8j\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:59:12.956746 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.956701 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" event={"ID":"ddebfe6a-047f-4738-8a50-2e0ab77de461","Type":"ContainerStarted","Data":"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54"} Jun 16 19:59:12.958190 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.958165 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" event={"ID":"976d6025-574a-4925-a057-4e847fc8c164","Type":"ContainerStarted","Data":"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60"} Jun 16 19:59:12.958323 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.958206 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" podUID="976d6025-574a-4925-a057-4e847fc8c164" containerName="authorino" containerID="cri-o://2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60" gracePeriod=30 Jun 16 19:59:12.959338 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.959314 2550 generic.go:356] "Generic (PLEG): container finished" podID="5b6460b3-2802-42dd-a607-f3006461fb8f" containerID="5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72" exitCode=0 Jun 16 19:59:12.959451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.959350 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" event={"ID":"5b6460b3-2802-42dd-a607-f3006461fb8f","Type":"ContainerDied","Data":"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72"} Jun 16 19:59:12.959451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.959371 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" event={"ID":"5b6460b3-2802-42dd-a607-f3006461fb8f","Type":"ContainerDied","Data":"10d2267d8a3e1d413b28919a8d3656155404aa28c6b024502612446a5e9bc988"} Jun 16 19:59:12.959451 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.959351 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-sc8v6" Jun 16 19:59:12.959586 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.959386 2550 scope.go:117] "RemoveContainer" containerID="5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72" Jun 16 19:59:12.968694 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.968675 2550 scope.go:117] "RemoveContainer" containerID="5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72" Jun 16 19:59:12.968944 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:59:12.968925 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72\": container with ID starting with 5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72 not found: ID does not exist" containerID="5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72" Jun 16 19:59:12.969071 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.968951 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72"} err="failed to get container status \"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72\": rpc error: code = NotFound desc = could not find container \"5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72\": container with ID starting with 5abbfee03dffb5c2434d7703d355bee396286b19a4df5d1663b115596eec6c72 not found: ID does not exist" Jun 16 19:59:12.974258 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.974218 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" podStartSLOduration=1.6306071709999999 podStartE2EDuration="1.974205161s" totalImagesPullingTime="343.59799ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:12.972684176 +0000 UTC m=+636.366676884" watchObservedRunningTime="2026-06-16 19:59:12.974205161 +0000 UTC m=+636.368197865" Jun 16 19:59:12.989111 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:12.989064 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" podStartSLOduration=1.547673393 podStartE2EDuration="1.989038597s" totalImagesPullingTime="441.365204ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:12.988168911 +0000 UTC m=+636.382161618" watchObservedRunningTime="2026-06-16 19:59:12.989038597 +0000 UTC m=+636.383031303" Jun 16 19:59:13.004726 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.004696 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:59:13.004891 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.004867 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9fmh6" podUID="e27041fc-1ac9-402c-9e4c-212926bd06c6" containerName="authorino" containerID="cri-o://7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d" gracePeriod=30 Jun 16 19:59:13.076941 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.076904 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:13.081800 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.081774 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-sc8v6"] Jun 16 19:59:13.095555 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.095531 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b6460b3-2802-42dd-a607-f3006461fb8f" path="/var/lib/kubelet/pods/5b6460b3-2802-42dd-a607-f3006461fb8f/volumes" Jun 16 19:59:13.261795 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.261769 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:13.278891 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.278866 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dlqd7\" (UniqueName: \"kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7\") pod \"976d6025-574a-4925-a057-4e847fc8c164\" (UID: \"976d6025-574a-4925-a057-4e847fc8c164\") " Jun 16 19:59:13.279443 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.279424 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:59:13.281008 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.280984 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7" (OuterVolumeSpecName: "kube-api-access-dlqd7") pod "976d6025-574a-4925-a057-4e847fc8c164" (UID: "976d6025-574a-4925-a057-4e847fc8c164"). InnerVolumeSpecName "kube-api-access-dlqd7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:59:13.379647 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.379612 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h69mc\" (UniqueName: \"kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc\") pod \"e27041fc-1ac9-402c-9e4c-212926bd06c6\" (UID: \"e27041fc-1ac9-402c-9e4c-212926bd06c6\") " Jun 16 19:59:13.379834 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.379822 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dlqd7\" (UniqueName: \"kubernetes.io/projected/976d6025-574a-4925-a057-4e847fc8c164-kube-api-access-dlqd7\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:59:13.381664 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.381630 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc" (OuterVolumeSpecName: "kube-api-access-h69mc") pod "e27041fc-1ac9-402c-9e4c-212926bd06c6" (UID: "e27041fc-1ac9-402c-9e4c-212926bd06c6"). InnerVolumeSpecName "kube-api-access-h69mc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:59:13.480536 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.480497 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h69mc\" (UniqueName: \"kubernetes.io/projected/e27041fc-1ac9-402c-9e4c-212926bd06c6-kube-api-access-h69mc\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 19:59:13.965670 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.965638 2550 generic.go:356] "Generic (PLEG): container finished" podID="976d6025-574a-4925-a057-4e847fc8c164" containerID="2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60" exitCode=0 Jun 16 19:59:13.966131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.965685 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" Jun 16 19:59:13.966131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.965728 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" event={"ID":"976d6025-574a-4925-a057-4e847fc8c164","Type":"ContainerDied","Data":"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60"} Jun 16 19:59:13.966131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.965776 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c64fcd5f6-v95g5" event={"ID":"976d6025-574a-4925-a057-4e847fc8c164","Type":"ContainerDied","Data":"307b253def0a51415fc416e40a2c0c0cbb8e3fd7b94c0b0cffc9ce6baafdeab0"} Jun 16 19:59:13.966131 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.965800 2550 scope.go:117] "RemoveContainer" containerID="2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60" Jun 16 19:59:13.967960 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.967937 2550 generic.go:356] "Generic (PLEG): container finished" podID="e27041fc-1ac9-402c-9e4c-212926bd06c6" containerID="7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d" exitCode=0 Jun 16 19:59:13.968058 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.967985 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9fmh6" Jun 16 19:59:13.968058 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.968014 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9fmh6" event={"ID":"e27041fc-1ac9-402c-9e4c-212926bd06c6","Type":"ContainerDied","Data":"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d"} Jun 16 19:59:13.968058 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.968053 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9fmh6" event={"ID":"e27041fc-1ac9-402c-9e4c-212926bd06c6","Type":"ContainerDied","Data":"cc79c408bd89f8d93882ba388ece5ebfab086cf0e8bfa940e0ce9c4663476e28"} Jun 16 19:59:13.975441 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.975400 2550 scope.go:117] "RemoveContainer" containerID="2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60" Jun 16 19:59:13.975721 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:59:13.975699 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60\": container with ID starting with 2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60 not found: ID does not exist" containerID="2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60" Jun 16 19:59:13.975801 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.975726 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60"} err="failed to get container status \"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60\": rpc error: code = NotFound desc = could not find container \"2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60\": container with ID starting with 2fb21961b926ce7f1e326fe6807605093e543979ec8fd5494335fa2cd2e94a60 not found: ID does not exist" Jun 16 19:59:13.975801 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.975745 2550 scope.go:117] "RemoveContainer" containerID="7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d" Jun 16 19:59:13.983419 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.983401 2550 scope.go:117] "RemoveContainer" containerID="7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d" Jun 16 19:59:13.983668 ip-10-0-138-253 kubenswrapper[2550]: E0616 19:59:13.983651 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d\": container with ID starting with 7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d not found: ID does not exist" containerID="7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d" Jun 16 19:59:13.983731 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.983675 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d"} err="failed to get container status \"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d\": rpc error: code = NotFound desc = could not find container \"7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d\": container with ID starting with 7d4f188d5ed1127c06fe4b2534a65de0cde2199e21f99fa6be1875b5770bc34d not found: ID does not exist" Jun 16 19:59:13.991357 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.991335 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:13.995937 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:13.995911 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c64fcd5f6-v95g5"] Jun 16 19:59:14.009314 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:14.009287 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:59:14.013517 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:14.013493 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9fmh6"] Jun 16 19:59:15.095758 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:15.095723 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="976d6025-574a-4925-a057-4e847fc8c164" path="/var/lib/kubelet/pods/976d6025-574a-4925-a057-4e847fc8c164/volumes" Jun 16 19:59:15.096211 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:15.096062 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e27041fc-1ac9-402c-9e4c-212926bd06c6" path="/var/lib/kubelet/pods/e27041fc-1ac9-402c-9e4c-212926bd06c6/volumes" Jun 16 19:59:16.586572 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:16.586463 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:16.820323 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:16.820281 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:17.000712 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:17.000676 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:19.253453 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:19.253408 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:19.390050 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:19.390015 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:35.280794 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:35.280763 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:35.372167 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:35.372133 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:48.103157 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:48.103119 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:50.268157 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:50.268122 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:50.368359 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:50.368325 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:50.762603 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:50.762567 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:50.862667 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:50.862615 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:59.188453 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.188420 2550 generic.go:356] "Generic (PLEG): container finished" podID="eb5d4452-f6b8-45d6-8574-11c75db1faaa" containerID="12a124b634485be100dcde2b78eb094a5d385b15f6a3969b679d447e7d360022" exitCode=0 Jun 16 19:59:59.188893 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.188500 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" event={"ID":"eb5d4452-f6b8-45d6-8574-11c75db1faaa","Type":"ContainerDied","Data":"12a124b634485be100dcde2b78eb094a5d385b15f6a3969b679d447e7d360022"} Jun 16 19:59:59.188978 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.188960 2550 scope.go:117] "RemoveContainer" containerID="12a124b634485be100dcde2b78eb094a5d385b15f6a3969b679d447e7d360022" Jun 16 19:59:59.190047 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.190013 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:59:59.190129 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.190084 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:59:59.190129 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.190116 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 19:59:59.731381 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.731342 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 19:59:59.835649 ip-10-0-138-253 kubenswrapper[2550]: I0616 19:59:59.835591 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:00:00.196416 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:00.196379 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" event={"ID":"eb5d4452-f6b8-45d6-8574-11c75db1faaa","Type":"ContainerStarted","Data":"070be2e4980236211cea8f4d8b37bb5b316b36527df1a9d187255b39326e10e2"} Jun 16 20:00:00.964217 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:00.964178 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 20:00:00.965466 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:00.965439 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfnlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 16 20:00:00.965603 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:00.965515 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" podUID="eb5d4452-f6b8-45d6-8574-11c75db1faaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 16 20:00:01.964854 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:01.964819 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfnlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 16 20:00:01.965287 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:01.964892 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" podUID="eb5d4452-f6b8-45d6-8574-11c75db1faaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 16 20:00:02.459529 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:02.459488 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:00:02.963941 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:02.963901 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfnlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 16 20:00:02.964149 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:02.963975 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" podUID="eb5d4452-f6b8-45d6-8574-11c75db1faaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 16 20:00:03.964228 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:03.964185 2550 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-sfnlq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body= Jun 16 20:00:03.964669 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:03.964282 2550 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" podUID="eb5d4452-f6b8-45d6-8574-11c75db1faaa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" Jun 16 20:00:04.402063 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:04.402025 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 20:00:04.968646 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:04.968611 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 20:00:05.220427 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:05.220347 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-sfnlq" Jun 16 20:00:49.280105 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280067 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280424 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b6460b3-2802-42dd-a607-f3006461fb8f" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280437 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b6460b3-2802-42dd-a607-f3006461fb8f" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280449 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e27041fc-1ac9-402c-9e4c-212926bd06c6" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280454 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="e27041fc-1ac9-402c-9e4c-212926bd06c6" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280489 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="976d6025-574a-4925-a057-4e847fc8c164" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280496 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="976d6025-574a-4925-a057-4e847fc8c164" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280555 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="e27041fc-1ac9-402c-9e4c-212926bd06c6" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280566 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="976d6025-574a-4925-a057-4e847fc8c164" containerName="authorino" Jun 16 20:00:49.280634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.280572 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b6460b3-2802-42dd-a607-f3006461fb8f" containerName="authorino" Jun 16 20:00:49.283622 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.283606 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.286959 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.286934 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 16 20:00:49.296619 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.296595 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:00:49.325111 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.325084 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.325251 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.325122 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v87st\" (UniqueName: \"kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.325251 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.325141 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.425826 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.425791 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v87st\" (UniqueName: \"kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.425826 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.425828 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.426088 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.425904 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.426554 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.426516 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.428356 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.428335 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.436904 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.436884 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v87st\" (UniqueName: \"kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st\") pod \"authorino-6bbbf4dbd6-5rl28\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.592643 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.592556 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:00:49.728339 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:49.728310 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:00:49.731199 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:00:49.731163 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf28630ae_6d8b_431a_8d9b_6255c3aded36.slice/crio-06653ca1aeac178ea87e2c924ddb2a433643ec66a5648503188a8c3f89058bcc WatchSource:0}: Error finding container 06653ca1aeac178ea87e2c924ddb2a433643ec66a5648503188a8c3f89058bcc: Status 404 returned error can't find the container with id 06653ca1aeac178ea87e2c924ddb2a433643ec66a5648503188a8c3f89058bcc Jun 16 20:00:50.435256 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.435164 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" event={"ID":"f28630ae-6d8b-431a-8d9b-6255c3aded36","Type":"ContainerStarted","Data":"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7"} Jun 16 20:00:50.435256 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.435210 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" event={"ID":"f28630ae-6d8b-431a-8d9b-6255c3aded36","Type":"ContainerStarted","Data":"06653ca1aeac178ea87e2c924ddb2a433643ec66a5648503188a8c3f89058bcc"} Jun 16 20:00:50.453703 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.453650 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" podStartSLOduration=1.028963517 podStartE2EDuration="1.453633609s" totalImagesPullingTime="424.670092ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:00:50.452633336 +0000 UTC m=+733.846626043" watchObservedRunningTime="2026-06-16 20:00:50.453633609 +0000 UTC m=+733.847626314" Jun 16 20:00:50.490155 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.490122 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 20:00:50.490346 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.490308 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" podUID="ddebfe6a-047f-4738-8a50-2e0ab77de461" containerName="authorino" containerID="cri-o://ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54" gracePeriod=30 Jun 16 20:00:50.741437 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.741408 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 20:00:50.835216 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.835186 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert\") pod \"ddebfe6a-047f-4738-8a50-2e0ab77de461\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " Jun 16 20:00:50.835392 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.835230 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x85hn\" (UniqueName: \"kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn\") pod \"ddebfe6a-047f-4738-8a50-2e0ab77de461\" (UID: \"ddebfe6a-047f-4738-8a50-2e0ab77de461\") " Jun 16 20:00:50.837297 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.837267 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn" (OuterVolumeSpecName: "kube-api-access-x85hn") pod "ddebfe6a-047f-4738-8a50-2e0ab77de461" (UID: "ddebfe6a-047f-4738-8a50-2e0ab77de461"). InnerVolumeSpecName "kube-api-access-x85hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:00:50.845663 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.845639 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "ddebfe6a-047f-4738-8a50-2e0ab77de461" (UID: "ddebfe6a-047f-4738-8a50-2e0ab77de461"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 20:00:50.936597 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.936554 2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ddebfe6a-047f-4738-8a50-2e0ab77de461-tls-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:00:50.936597 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:50.936592 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x85hn\" (UniqueName: \"kubernetes.io/projected/ddebfe6a-047f-4738-8a50-2e0ab77de461-kube-api-access-x85hn\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:00:51.185730 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.185694 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:00:51.268320 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.268288 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:00:51.441260 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.441229 2550 generic.go:356] "Generic (PLEG): container finished" podID="ddebfe6a-047f-4738-8a50-2e0ab77de461" containerID="ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54" exitCode=0 Jun 16 20:00:51.441803 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.441280 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" Jun 16 20:00:51.441803 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.441316 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" event={"ID":"ddebfe6a-047f-4738-8a50-2e0ab77de461","Type":"ContainerDied","Data":"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54"} Jun 16 20:00:51.441803 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.441360 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67f695b7cb-f5fp2" event={"ID":"ddebfe6a-047f-4738-8a50-2e0ab77de461","Type":"ContainerDied","Data":"8711c86ff51331015b088237cd4b890f43d27131c6af2759a06342a2d390676d"} Jun 16 20:00:51.441803 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.441381 2550 scope.go:117] "RemoveContainer" containerID="ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54" Jun 16 20:00:51.449872 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.449851 2550 scope.go:117] "RemoveContainer" containerID="ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54" Jun 16 20:00:51.450127 ip-10-0-138-253 kubenswrapper[2550]: E0616 20:00:51.450111 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54\": container with ID starting with ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54 not found: ID does not exist" containerID="ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54" Jun 16 20:00:51.450172 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.450135 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54"} err="failed to get container status \"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54\": rpc error: code = NotFound desc = could not find container \"ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54\": container with ID starting with ae19cc67afd3e8c9af579125a6e2b91a71084a15ebb1d7264e7497d2c7b43f54 not found: ID does not exist" Jun 16 20:00:51.467850 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.465429 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 20:00:51.470825 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:51.470793 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-67f695b7cb-f5fp2"] Jun 16 20:00:53.095587 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:00:53.095555 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddebfe6a-047f-4738-8a50-2e0ab77de461" path="/var/lib/kubelet/pods/ddebfe6a-047f-4738-8a50-2e0ab77de461/volumes" Jun 16 20:01:00.535632 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:00.535593 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:08.208621 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:08.208584 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:28.342239 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:28.342191 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:39.918291 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:39.918254 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:44.957998 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:44.957951 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:50.082668 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.082633 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q"] Jun 16 20:01:50.083115 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.083007 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ddebfe6a-047f-4738-8a50-2e0ab77de461" containerName="authorino" Jun 16 20:01:50.083115 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.083021 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="ddebfe6a-047f-4738-8a50-2e0ab77de461" containerName="authorino" Jun 16 20:01:50.083115 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.083086 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="ddebfe6a-047f-4738-8a50-2e0ab77de461" containerName="authorino" Jun 16 20:01:50.087431 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.087404 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.090196 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.090176 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 16 20:01:50.091233 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.091213 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 16 20:01:50.091391 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.091326 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 16 20:01:50.091391 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.091366 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mrjxh\"" Jun 16 20:01:50.096270 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.096246 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q"] Jun 16 20:01:50.178607 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.178574 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.178793 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.178710 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95639ed9-94c9-4d47-bb04-622c78d77b10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.178836 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.178785 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/95639ed9-94c9-4d47-bb04-622c78d77b10-kube-api-access-c9ngm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.178873 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.178834 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.178922 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.178907 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.248222 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.248178 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:01:50.280112 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280076 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280305 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280142 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95639ed9-94c9-4d47-bb04-622c78d77b10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280305 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280172 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/95639ed9-94c9-4d47-bb04-622c78d77b10-kube-api-access-c9ngm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280305 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280202 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280305 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280255 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280636 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280615 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-home\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.280729 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.280703 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.282364 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.282344 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95639ed9-94c9-4d47-bb04-622c78d77b10-dshm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.282547 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.282529 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95639ed9-94c9-4d47-bb04-622c78d77b10-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.289460 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.289437 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9ngm\" (UniqueName: \"kubernetes.io/projected/95639ed9-94c9-4d47-bb04-622c78d77b10-kube-api-access-c9ngm\") pod \"premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q\" (UID: \"95639ed9-94c9-4d47-bb04-622c78d77b10\") " pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.397271 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.397233 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:01:50.534381 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.534311 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q"] Jun 16 20:01:50.537969 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:01:50.537932 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95639ed9_94c9_4d47_bb04_622c78d77b10.slice/crio-e465d541d5aceeea63bf6b1e55d47860dd0d467eb1de0eff49f4e803e57537c7 WatchSource:0}: Error finding container e465d541d5aceeea63bf6b1e55d47860dd0d467eb1de0eff49f4e803e57537c7: Status 404 returned error can't find the container with id e465d541d5aceeea63bf6b1e55d47860dd0d467eb1de0eff49f4e803e57537c7 Jun 16 20:01:50.725244 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:50.725149 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" event={"ID":"95639ed9-94c9-4d47-bb04-622c78d77b10","Type":"ContainerStarted","Data":"e465d541d5aceeea63bf6b1e55d47860dd0d467eb1de0eff49f4e803e57537c7"} Jun 16 20:01:51.731979 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:51.731940 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" event={"ID":"95639ed9-94c9-4d47-bb04-622c78d77b10","Type":"ContainerStarted","Data":"67c08ed3aa3fbce60aa320fe4ee83ef3bf4f18ec1c1ee4fa5a2a4b4caee09606"} Jun 16 20:01:51.753758 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:01:51.753706 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" podStartSLOduration=0.666076006 podStartE2EDuration="1.753690207s" totalImagesPullingTime="1.087614201s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:51.751604567 +0000 UTC m=+795.145597273" watchObservedRunningTime="2026-06-16 20:01:51.753690207 +0000 UTC m=+795.147682912" Jun 16 20:02:00.398386 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:02:00.398289 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:02:00.398386 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:02:00.398340 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:02:00.410994 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:02:00.410968 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:02:00.783809 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:02:00.783727 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q" Jun 16 20:02:58.502703 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:02:58.502669 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:03:16.106139 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.106102 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f4d6875-fn87r"] Jun 16 20:03:16.112538 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.112510 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.121284 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.121258 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4d6875-fn87r"] Jun 16 20:03:16.140122 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.140088 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnvf\" (UniqueName: \"kubernetes.io/projected/3db7327f-0973-4f04-b3d0-3eb0415b7209-kube-api-access-bpnvf\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.140301 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.140269 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3db7327f-0973-4f04-b3d0-3eb0415b7209-tls-cert\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.140495 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.140377 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3db7327f-0973-4f04-b3d0-3eb0415b7209-oidc-ca\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.241274 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.241242 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3db7327f-0973-4f04-b3d0-3eb0415b7209-oidc-ca\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.241462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.241413 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnvf\" (UniqueName: \"kubernetes.io/projected/3db7327f-0973-4f04-b3d0-3eb0415b7209-kube-api-access-bpnvf\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.241547 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.241512 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3db7327f-0973-4f04-b3d0-3eb0415b7209-tls-cert\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.241970 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.241952 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3db7327f-0973-4f04-b3d0-3eb0415b7209-oidc-ca\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.243919 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.243899 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3db7327f-0973-4f04-b3d0-3eb0415b7209-tls-cert\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.252707 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.252685 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnvf\" (UniqueName: \"kubernetes.io/projected/3db7327f-0973-4f04-b3d0-3eb0415b7209-kube-api-access-bpnvf\") pod \"authorino-5f4d6875-fn87r\" (UID: \"3db7327f-0973-4f04-b3d0-3eb0415b7209\") " pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.422542 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.422507 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f4d6875-fn87r" Jun 16 20:03:16.593911 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.593878 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:03:16.595940 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:03:16.595915 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3db7327f_0973_4f04_b3d0_3eb0415b7209.slice/crio-97fc4bc76b841f34b66905526ec61839d3b46398e6f8cb1edc27c91267dcc696 WatchSource:0}: Error finding container 97fc4bc76b841f34b66905526ec61839d3b46398e6f8cb1edc27c91267dcc696: Status 404 returned error can't find the container with id 97fc4bc76b841f34b66905526ec61839d3b46398e6f8cb1edc27c91267dcc696 Jun 16 20:03:16.630563 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:16.630527 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f4d6875-fn87r"] Jun 16 20:03:17.143357 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.143321 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4d6875-fn87r" event={"ID":"3db7327f-0973-4f04-b3d0-3eb0415b7209","Type":"ContainerStarted","Data":"bafdf17e76d92f84c475f4cdc74ed7a411225ae52dfe2898e6e4ca144e7eb30f"} Jun 16 20:03:17.143357 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.143363 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f4d6875-fn87r" event={"ID":"3db7327f-0973-4f04-b3d0-3eb0415b7209","Type":"ContainerStarted","Data":"97fc4bc76b841f34b66905526ec61839d3b46398e6f8cb1edc27c91267dcc696"} Jun 16 20:03:17.177458 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.177407 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f4d6875-fn87r" podStartSLOduration=0.709503057 podStartE2EDuration="1.177391622s" totalImagesPullingTime="467.888565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:03:17.176041268 +0000 UTC m=+880.570033974" watchObservedRunningTime="2026-06-16 20:03:17.177391622 +0000 UTC m=+880.571384608" Jun 16 20:03:17.214711 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.214666 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:03:17.238695 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.238666 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:03:17.238941 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.238900 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" podUID="f28630ae-6d8b-431a-8d9b-6255c3aded36" containerName="authorino" containerID="cri-o://fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7" gracePeriod=30 Jun 16 20:03:17.516885 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.516858 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:03:17.553235 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.553196 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert\") pod \"f28630ae-6d8b-431a-8d9b-6255c3aded36\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " Jun 16 20:03:17.553458 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.553264 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v87st\" (UniqueName: \"kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st\") pod \"f28630ae-6d8b-431a-8d9b-6255c3aded36\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " Jun 16 20:03:17.553458 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.553293 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca\") pod \"f28630ae-6d8b-431a-8d9b-6255c3aded36\" (UID: \"f28630ae-6d8b-431a-8d9b-6255c3aded36\") " Jun 16 20:03:17.555960 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.555919 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st" (OuterVolumeSpecName: "kube-api-access-v87st") pod "f28630ae-6d8b-431a-8d9b-6255c3aded36" (UID: "f28630ae-6d8b-431a-8d9b-6255c3aded36"). InnerVolumeSpecName "kube-api-access-v87st". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:03:17.560291 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.560260 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "f28630ae-6d8b-431a-8d9b-6255c3aded36" (UID: "f28630ae-6d8b-431a-8d9b-6255c3aded36"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 20:03:17.564908 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.564883 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f28630ae-6d8b-431a-8d9b-6255c3aded36" (UID: "f28630ae-6d8b-431a-8d9b-6255c3aded36"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 20:03:17.654653 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.654620 2550 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f28630ae-6d8b-431a-8d9b-6255c3aded36-tls-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:03:17.654653 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.654650 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v87st\" (UniqueName: \"kubernetes.io/projected/f28630ae-6d8b-431a-8d9b-6255c3aded36-kube-api-access-v87st\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:03:17.654653 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.654660 2550 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/f28630ae-6d8b-431a-8d9b-6255c3aded36-oidc-ca\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:03:17.740997 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.740960 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:03:17.843648 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:17.843608 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:03:18.149782 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.149752 2550 generic.go:356] "Generic (PLEG): container finished" podID="f28630ae-6d8b-431a-8d9b-6255c3aded36" containerID="fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7" exitCode=0 Jun 16 20:03:18.150224 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.149815 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" Jun 16 20:03:18.150224 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.149843 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" event={"ID":"f28630ae-6d8b-431a-8d9b-6255c3aded36","Type":"ContainerDied","Data":"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7"} Jun 16 20:03:18.150224 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.149885 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bbbf4dbd6-5rl28" event={"ID":"f28630ae-6d8b-431a-8d9b-6255c3aded36","Type":"ContainerDied","Data":"06653ca1aeac178ea87e2c924ddb2a433643ec66a5648503188a8c3f89058bcc"} Jun 16 20:03:18.150224 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.149904 2550 scope.go:117] "RemoveContainer" containerID="fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7" Jun 16 20:03:18.158646 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.158459 2550 scope.go:117] "RemoveContainer" containerID="fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7" Jun 16 20:03:18.158853 ip-10-0-138-253 kubenswrapper[2550]: E0616 20:03:18.158834 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7\": container with ID starting with fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7 not found: ID does not exist" containerID="fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7" Jun 16 20:03:18.158909 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.158861 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7"} err="failed to get container status \"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7\": rpc error: code = NotFound desc = could not find container \"fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7\": container with ID starting with fb37d45a9c0297b3ea6f301ef13eaee0402516fca85744756d614166358442b7 not found: ID does not exist" Jun 16 20:03:18.176178 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.176155 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:03:18.181486 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:18.181449 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6bbbf4dbd6-5rl28"] Jun 16 20:03:19.094892 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:19.094860 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f28630ae-6d8b-431a-8d9b-6255c3aded36" path="/var/lib/kubelet/pods/f28630ae-6d8b-431a-8d9b-6255c3aded36/volumes" Jun 16 20:03:37.101167 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:37.101073 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:03:37.102379 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:37.102355 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:03:37.105611 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:37.105586 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:03:37.106430 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:37.106410 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:03:59.690953 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:03:59.690915 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:02.944052 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:02.944003 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:05.103926 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:05.103896 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:46.641861 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:46.641826 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:46.740060 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:46.740024 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:46.870775 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:46.870735 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:53.830014 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:53.829977 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:53.965515 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:53.965457 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:54.080575 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:54.080459 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:05:54.247715 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:05:54.247684 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:06:00.530934 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:06:00.530889 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:06:00.632284 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:06:00.632245 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:06:12.594825 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:06:12.594781 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:06:12.658847 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:06:12.658809 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:08:37.130602 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:08:37.130576 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:08:37.133330 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:08:37.133306 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:08:37.134422 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:08:37.134401 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:08:37.136839 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:08:37.136820 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:09:51.810528 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:09:51.810486 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:12:01.090818 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:01.090781 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:12:17.801362 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:17.801324 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:12:47.988095 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:47.988059 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 20:12:47.988630 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:47.988256 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" podUID="effc64bc-6d47-490a-904e-a440d6180802" containerName="manager" containerID="cri-o://c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07" gracePeriod=10 Jun 16 20:12:48.245398 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.245341 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 20:12:48.322565 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.322531 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwdcm\" (UniqueName: \"kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm\") pod \"effc64bc-6d47-490a-904e-a440d6180802\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " Jun 16 20:12:48.322738 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.322589 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume\") pod \"effc64bc-6d47-490a-904e-a440d6180802\" (UID: \"effc64bc-6d47-490a-904e-a440d6180802\") " Jun 16 20:12:48.323000 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.322979 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "effc64bc-6d47-490a-904e-a440d6180802" (UID: "effc64bc-6d47-490a-904e-a440d6180802"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:12:48.324640 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.324611 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm" (OuterVolumeSpecName: "kube-api-access-cwdcm") pod "effc64bc-6d47-490a-904e-a440d6180802" (UID: "effc64bc-6d47-490a-904e-a440d6180802"). InnerVolumeSpecName "kube-api-access-cwdcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:12:48.423775 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.423731 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwdcm\" (UniqueName: \"kubernetes.io/projected/effc64bc-6d47-490a-904e-a440d6180802-kube-api-access-cwdcm\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:12:48.423775 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.423767 2550 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/effc64bc-6d47-490a-904e-a440d6180802-extensions-socket-volume\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:12:48.849163 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.849127 2550 generic.go:356] "Generic (PLEG): container finished" podID="effc64bc-6d47-490a-904e-a440d6180802" containerID="c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07" exitCode=0 Jun 16 20:12:48.849343 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.849173 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" Jun 16 20:12:48.849343 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.849215 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" event={"ID":"effc64bc-6d47-490a-904e-a440d6180802","Type":"ContainerDied","Data":"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07"} Jun 16 20:12:48.849343 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.849297 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl" event={"ID":"effc64bc-6d47-490a-904e-a440d6180802","Type":"ContainerDied","Data":"87ca99c30acc2bb2e655d75b37035323840f63f735159660478ac736284446bf"} Jun 16 20:12:48.849343 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.849320 2550 scope.go:117] "RemoveContainer" containerID="c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07" Jun 16 20:12:48.859003 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.858986 2550 scope.go:117] "RemoveContainer" containerID="c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07" Jun 16 20:12:48.859243 ip-10-0-138-253 kubenswrapper[2550]: E0616 20:12:48.859224 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07\": container with ID starting with c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07 not found: ID does not exist" containerID="c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07" Jun 16 20:12:48.859293 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.859251 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07"} err="failed to get container status \"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07\": rpc error: code = NotFound desc = could not find container \"c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07\": container with ID starting with c185623e973378f9ebb53ba7f6cbb2baafb5d53246193dcaaa9ba9b9bf08fb07 not found: ID does not exist" Jun 16 20:12:48.884103 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.884079 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 20:12:48.890716 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:48.890690 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-w52jl"] Jun 16 20:12:49.095045 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:12:49.095000 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="effc64bc-6d47-490a-904e-a440d6180802" path="/var/lib/kubelet/pods/effc64bc-6d47-490a-904e-a440d6180802/volumes" Jun 16 20:13:37.158005 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:37.157973 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:13:37.161394 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:37.161371 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:13:37.161715 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:37.161695 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:13:37.165345 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:37.165325 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:13:49.151624 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.151564 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq"] Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.151929 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="effc64bc-6d47-490a-904e-a440d6180802" containerName="manager" Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.151942 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="effc64bc-6d47-490a-904e-a440d6180802" containerName="manager" Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.151955 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f28630ae-6d8b-431a-8d9b-6255c3aded36" containerName="authorino" Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.151962 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="f28630ae-6d8b-431a-8d9b-6255c3aded36" containerName="authorino" Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.152016 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="f28630ae-6d8b-431a-8d9b-6255c3aded36" containerName="authorino" Jun 16 20:13:49.152029 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.152026 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="effc64bc-6d47-490a-904e-a440d6180802" containerName="manager" Jun 16 20:13:49.156143 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.156125 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.159922 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.159901 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x7c9f\"" Jun 16 20:13:49.169502 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.169462 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq"] Jun 16 20:13:49.178998 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.178974 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d606f7-c5f7-45c2-b218-117a06cead06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.179153 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.179129 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8glnx\" (UniqueName: \"kubernetes.io/projected/b1d606f7-c5f7-45c2-b218-117a06cead06-kube-api-access-8glnx\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.279807 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.279758 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8glnx\" (UniqueName: \"kubernetes.io/projected/b1d606f7-c5f7-45c2-b218-117a06cead06-kube-api-access-8glnx\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.279807 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.279816 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d606f7-c5f7-45c2-b218-117a06cead06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.280326 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.280302 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b1d606f7-c5f7-45c2-b218-117a06cead06-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.294091 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.294060 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8glnx\" (UniqueName: \"kubernetes.io/projected/b1d606f7-c5f7-45c2-b218-117a06cead06-kube-api-access-8glnx\") pod \"kuadrant-operator-controller-manager-86878c769f-qzdtq\" (UID: \"b1d606f7-c5f7-45c2-b218-117a06cead06\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.466624 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.466526 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:49.621747 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:49.621720 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq"] Jun 16 20:13:49.624657 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:13:49.624629 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1d606f7_c5f7_45c2_b218_117a06cead06.slice/crio-71ecf2eea30798beb3a708230e25a9e3ba44ccff1ffd53761100f6c74bd3fbf5 WatchSource:0}: Error finding container 71ecf2eea30798beb3a708230e25a9e3ba44ccff1ffd53761100f6c74bd3fbf5: Status 404 returned error can't find the container with id 71ecf2eea30798beb3a708230e25a9e3ba44ccff1ffd53761100f6c74bd3fbf5 Jun 16 20:13:50.137957 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:50.137915 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" event={"ID":"b1d606f7-c5f7-45c2-b218-117a06cead06","Type":"ContainerStarted","Data":"5e0cab86e1117919410203bf3710f65ef81df06422202693d322a51dfb7af3c6"} Jun 16 20:13:50.138177 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:50.137972 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" event={"ID":"b1d606f7-c5f7-45c2-b218-117a06cead06","Type":"ContainerStarted","Data":"71ecf2eea30798beb3a708230e25a9e3ba44ccff1ffd53761100f6c74bd3fbf5"} Jun 16 20:13:50.138177 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:50.138066 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:13:50.167061 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:13:50.167003 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" podStartSLOduration=1.16698914 podStartE2EDuration="1.16698914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:13:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:13:50.163880929 +0000 UTC m=+1513.557873636" watchObservedRunningTime="2026-06-16 20:13:50.16698914 +0000 UTC m=+1513.560981845" Jun 16 20:14:01.144932 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:14:01.144896 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qzdtq" Jun 16 20:14:40.315776 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:14:40.315737 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:14:40.400443 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:14:40.400383 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:15:00.180486 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.180437 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29694015-w9gjq"] Jun 16 20:15:00.183935 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.183917 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:00.188550 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.188528 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-97fh2\"" Jun 16 20:15:00.195798 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.195776 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29694015-w9gjq"] Jun 16 20:15:00.298817 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.298782 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqwps\" (UniqueName: \"kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps\") pod \"maas-api-key-cleanup-29694015-w9gjq\" (UID: \"8ad41df7-b542-4bed-a4a7-19ca022a4af1\") " pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:00.399542 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.399502 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqwps\" (UniqueName: \"kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps\") pod \"maas-api-key-cleanup-29694015-w9gjq\" (UID: \"8ad41df7-b542-4bed-a4a7-19ca022a4af1\") " pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:00.416841 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.416801 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqwps\" (UniqueName: \"kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps\") pod \"maas-api-key-cleanup-29694015-w9gjq\" (UID: \"8ad41df7-b542-4bed-a4a7-19ca022a4af1\") " pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:00.494704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.494607 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:00.630584 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.630556 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29694015-w9gjq"] Jun 16 20:15:00.633755 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:15:00.633724 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ad41df7_b542_4bed_a4a7_19ca022a4af1.slice/crio-50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a WatchSource:0}: Error finding container 50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a: Status 404 returned error can't find the container with id 50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a Jun 16 20:15:00.635839 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:00.635820 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 20:15:01.471404 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:01.471362 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" event={"ID":"8ad41df7-b542-4bed-a4a7-19ca022a4af1","Type":"ContainerStarted","Data":"50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a"} Jun 16 20:15:03.483154 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:03.483115 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" event={"ID":"8ad41df7-b542-4bed-a4a7-19ca022a4af1","Type":"ContainerStarted","Data":"f8fde8fd02c92db78f63d87abd71a0213f1c77ab56ed4c1e410c5425ff6601d5"} Jun 16 20:15:03.500921 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:03.500867 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" podStartSLOduration=1.313171395 podStartE2EDuration="3.500850962s" totalImagesPullingTime="2.187679567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:15:03.499193242 +0000 UTC m=+1586.893185949" watchObservedRunningTime="2026-06-16 20:15:03.500850962 +0000 UTC m=+1586.894843668" Jun 16 20:15:04.489464 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:04.489420 2550 generic.go:356] "Generic (PLEG): container finished" podID="8ad41df7-b542-4bed-a4a7-19ca022a4af1" containerID="f8fde8fd02c92db78f63d87abd71a0213f1c77ab56ed4c1e410c5425ff6601d5" exitCode=0 Jun 16 20:15:04.491906 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:04.489505 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" event={"ID":"8ad41df7-b542-4bed-a4a7-19ca022a4af1","Type":"ContainerDied","Data":"f8fde8fd02c92db78f63d87abd71a0213f1c77ab56ed4c1e410c5425ff6601d5"} Jun 16 20:15:05.639990 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:05.639960 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:05.750053 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:05.749950 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pqwps\" (UniqueName: \"kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps\") pod \"8ad41df7-b542-4bed-a4a7-19ca022a4af1\" (UID: \"8ad41df7-b542-4bed-a4a7-19ca022a4af1\") " Jun 16 20:15:05.752211 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:05.752177 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps" (OuterVolumeSpecName: "kube-api-access-pqwps") pod "8ad41df7-b542-4bed-a4a7-19ca022a4af1" (UID: "8ad41df7-b542-4bed-a4a7-19ca022a4af1"). InnerVolumeSpecName "kube-api-access-pqwps". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:15:05.850819 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:05.850784 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqwps\" (UniqueName: \"kubernetes.io/projected/8ad41df7-b542-4bed-a4a7-19ca022a4af1-kube-api-access-pqwps\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:15:06.499867 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:06.499834 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" Jun 16 20:15:06.500077 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:06.499887 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29694015-w9gjq" event={"ID":"8ad41df7-b542-4bed-a4a7-19ca022a4af1","Type":"ContainerDied","Data":"50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a"} Jun 16 20:15:06.500077 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:15:06.499935 2550 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50592e2d7d656273af02270ab82fedd4ec9ae96df7b483ac69133c0496163d9a" Jun 16 20:16:11.644793 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:16:11.644762 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:18:37.194353 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:18:37.194319 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:18:37.198114 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:18:37.198093 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:18:37.199353 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:18:37.199335 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:18:37.202913 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:18:37.202895 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:20:20.752730 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:20:20.752698 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:21:33.105196 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:21:33.105110 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:21:35.187546 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:21:35.187508 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:22:34.376366 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:22:34.376327 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:22:39.684043 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:22:39.684010 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:03.931303 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:03.931225 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:17.073815 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:17.073781 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:18.686337 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:18.686309 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:18.781748 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:18.781716 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:19.204556 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:19.204509 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:25.894076 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:25.894045 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:25.994133 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:25.994103 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:26.091544 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.091502 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:26.092047 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.092027 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ad41df7-b542-4bed-a4a7-19ca022a4af1" containerName="cleanup" Jun 16 20:23:26.092093 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.092053 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ad41df7-b542-4bed-a4a7-19ca022a4af1" containerName="cleanup" Jun 16 20:23:26.092169 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.092156 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ad41df7-b542-4bed-a4a7-19ca022a4af1" containerName="cleanup" Jun 16 20:23:26.095587 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.095567 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.098538 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.098521 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-491b47a8-openshift-default-dockercfg-qfpdv\"" Jun 16 20:23:26.116657 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.116631 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:26.132036 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.132002 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:26.229704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.229584 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:26.233503 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233456 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233595 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233515 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233595 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233532 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8kx6\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233595 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233560 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233595 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233580 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233756 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233600 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233756 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233659 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233756 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233677 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.233756 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.233702 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.322403 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.322363 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:26.334754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334724 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.334881 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334768 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.334881 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334810 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.334881 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334876 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334905 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334929 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8kx6\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334958 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.334989 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335013 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335307 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335267 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335575 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335548 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335762 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335581 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335862 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335815 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.335959 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.335938 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.337253 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.337230 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.337789 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.337767 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.348793 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.348767 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8kx6\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.348957 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.348935 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token\") pod \"e2e-ait-491b47a8-openshift-default-d567549b6-ltckh\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.406445 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.406419 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:26.422649 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.422622 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:26.559092 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.559057 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:26.563413 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:23:26.563386 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208e031d_579b_4379_96fd_44e79669344e.slice/crio-aad6f8360d6e2e9ca12a179492caca2def64199070986ce3633130a2d815f8ea WatchSource:0}: Error finding container aad6f8360d6e2e9ca12a179492caca2def64199070986ce3633130a2d815f8ea: Status 404 returned error can't find the container with id aad6f8360d6e2e9ca12a179492caca2def64199070986ce3633130a2d815f8ea Jun 16 20:23:26.565519 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.565450 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:26.565597 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.565563 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:26.565636 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.565594 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:26.917590 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.917552 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" event={"ID":"208e031d-579b-4379-96fd-44e79669344e","Type":"ContainerStarted","Data":"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85"} Jun 16 20:23:26.917983 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.917608 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" event={"ID":"208e031d-579b-4379-96fd-44e79669344e","Type":"ContainerStarted","Data":"aad6f8360d6e2e9ca12a179492caca2def64199070986ce3633130a2d815f8ea"} Jun 16 20:23:26.952903 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:26.952856 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" podStartSLOduration=0.95284367 podStartE2EDuration="952.84367ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:23:26.952563815 +0000 UTC m=+2090.346556521" watchObservedRunningTime="2026-06-16 20:23:26.95284367 +0000 UTC m=+2090.346836442" Jun 16 20:23:27.406756 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:27.406727 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:27.411412 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:27.411383 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:27.922258 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:27.922231 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:27.923182 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:27.923161 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:29.711036 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:29.711010 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:32.405126 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:32.405096 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:32.561693 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:32.561658 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:32.561850 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:32.561831 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" podUID="208e031d-579b-4379-96fd-44e79669344e" containerName="istio-proxy" containerID="cri-o://a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85" gracePeriod=30 Jun 16 20:23:32.582559 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:32.582513 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:32.683904 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:32.683816 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:34.504116 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:34.504080 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:37.222102 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.222072 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:23:37.226009 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.225990 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:23:37.228334 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.228306 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:23:37.232090 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.232073 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:23:37.814920 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.814893 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:37.931705 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931677 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.931870 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931748 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.931870 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931772 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.931870 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931800 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.931870 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931825 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.931870 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931856 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931891 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8kx6\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.931926 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932005 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket\") pod \"208e031d-579b-4379-96fd-44e79669344e\" (UID: \"208e031d-579b-4379-96fd-44e79669344e\") " Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932073 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932086 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data" (OuterVolumeSpecName: "istio-data") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:37.932120 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932095 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:37.932552 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932303 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:37.932552 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932357 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 20:23:37.932666 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932652 2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-credential-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:37.932714 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.932674 2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-data\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:37.934355 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.934322 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token" (OuterVolumeSpecName: "istio-token") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:23:37.934355 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.934328 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6" (OuterVolumeSpecName: "kube-api-access-x8kx6") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "kube-api-access-x8kx6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:23:37.934559 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.934387 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 16 20:23:37.934559 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.934552 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "208e031d-579b-4379-96fd-44e79669344e" (UID: "208e031d-579b-4379-96fd-44e79669344e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:37.973378 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.973345 2550 generic.go:356] "Generic (PLEG): container finished" podID="208e031d-579b-4379-96fd-44e79669344e" containerID="a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85" exitCode=0 Jun 16 20:23:37.973510 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.973403 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" Jun 16 20:23:37.973510 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.973423 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" event={"ID":"208e031d-579b-4379-96fd-44e79669344e","Type":"ContainerDied","Data":"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85"} Jun 16 20:23:37.973510 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.973483 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh" event={"ID":"208e031d-579b-4379-96fd-44e79669344e","Type":"ContainerDied","Data":"aad6f8360d6e2e9ca12a179492caca2def64199070986ce3633130a2d815f8ea"} Jun 16 20:23:37.973649 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.973515 2550 scope.go:117] "RemoveContainer" containerID="a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85" Jun 16 20:23:37.983526 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.983507 2550 scope.go:117] "RemoveContainer" containerID="a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85" Jun 16 20:23:37.983768 ip-10-0-138-253 kubenswrapper[2550]: E0616 20:23:37.983749 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85\": container with ID starting with a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85 not found: ID does not exist" containerID="a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85" Jun 16 20:23:37.983818 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.983775 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85"} err="failed to get container status \"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85\": rpc error: code = NotFound desc = could not find container \"a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85\": container with ID starting with a41088457222521a7a04c6dde402483ea075dac0c4d26563af6c414d786e4f85 not found: ID does not exist" Jun 16 20:23:37.998586 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:37.998562 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:38.006943 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.006924 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-491b47a8-openshift-default-d567549b6-ltckh"] Jun 16 20:23:38.033313 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033293 2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208e031d-579b-4379-96fd-44e79669344e-istio-podinfo\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033315 2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-certs\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033330 2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-istio-token\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033343 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8kx6\" (UniqueName: \"kubernetes.io/projected/208e031d-579b-4379-96fd-44e79669344e-kube-api-access-x8kx6\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033357 2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-istio-envoy\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033370 2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208e031d-579b-4379-96fd-44e79669344e-workload-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:38.033408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:38.033383 2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208e031d-579b-4379-96fd-44e79669344e-istiod-ca-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:39.094758 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.094725 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="208e031d-579b-4379-96fd-44e79669344e" path="/var/lib/kubelet/pods/208e031d-579b-4379-96fd-44e79669344e/volumes" Jun 16 20:23:39.160006 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.159980 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.263547 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.263522 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.343418 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.343385 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:39.343944 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.343927 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208e031d-579b-4379-96fd-44e79669344e" containerName="istio-proxy" Jun 16 20:23:39.344023 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.343947 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="208e031d-579b-4379-96fd-44e79669344e" containerName="istio-proxy" Jun 16 20:23:39.344067 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.344033 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="208e031d-579b-4379-96fd-44e79669344e" containerName="istio-proxy" Jun 16 20:23:39.348726 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.348671 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.351414 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.351392 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-2cc47257-openshift-default-dockercfg-nd2fk\"" Jun 16 20:23:39.359639 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.359614 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:39.381840 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.381815 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.445244 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445204 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445390 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445268 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445390 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445295 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445390 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445320 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj8nc\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445390 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445366 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445604 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445412 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445604 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445438 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445604 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445458 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.445604 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.445529 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.520985 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.520958 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.546194 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546164 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546321 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546206 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546321 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546227 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546428 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546323 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546428 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546419 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546576 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546459 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546576 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546498 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546576 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546516 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj8nc\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546576 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546548 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546779 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546701 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546833 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.546981 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.546958 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.547048 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.547023 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.547126 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.547105 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.549116 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.549091 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.549225 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.549208 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.565590 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.565562 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.566114 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.566093 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj8nc\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc\") pod \"e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.616432 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.616408 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.660358 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.660323 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:39.703735 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.703703 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:39.802249 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.802212 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:39.803672 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:23:39.803646 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf784d4_e494_4c0b_8268_08959219d444.slice/crio-17ccc97be3fa1806a3ecb63b6c30f85fe368be8430d00f28bf76acff59383bdd WatchSource:0}: Error finding container 17ccc97be3fa1806a3ecb63b6c30f85fe368be8430d00f28bf76acff59383bdd: Status 404 returned error can't find the container with id 17ccc97be3fa1806a3ecb63b6c30f85fe368be8430d00f28bf76acff59383bdd Jun 16 20:23:39.805899 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.805867 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:39.805991 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.805930 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:39.805991 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.805960 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:39.987990 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.987905 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" event={"ID":"6cf784d4-e494-4c0b-8268-08959219d444","Type":"ContainerStarted","Data":"f39d38e4628bb300788764ea38c5d3a8e39e21b3036911e9021984e7a4bfe0a3"} Jun 16 20:23:39.987990 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:39.987958 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" event={"ID":"6cf784d4-e494-4c0b-8268-08959219d444","Type":"ContainerStarted","Data":"17ccc97be3fa1806a3ecb63b6c30f85fe368be8430d00f28bf76acff59383bdd"} Jun 16 20:23:40.012087 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:40.012006 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" podStartSLOduration=1.011987526 podStartE2EDuration="1.011987526s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:23:40.011353566 +0000 UTC m=+2103.405346272" watchObservedRunningTime="2026-06-16 20:23:40.011987526 +0000 UTC m=+2103.405980234" Jun 16 20:23:40.661025 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:40.660994 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:40.665708 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:40.665685 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:40.992984 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:40.992906 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:40.993894 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:40.993869 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:42.739908 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:42.739877 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:45.715109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:45.715071 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:46.857746 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:46.857700 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:46.858148 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:46.857903 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" podUID="6cf784d4-e494-4c0b-8268-08959219d444" containerName="istio-proxy" containerID="cri-o://f39d38e4628bb300788764ea38c5d3a8e39e21b3036911e9021984e7a4bfe0a3" gracePeriod=30 Jun 16 20:23:46.880589 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:46.880559 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:46.982760 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:46.982728 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:48.909892 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:48.909859 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:52.048770 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.048688 2550 generic.go:356] "Generic (PLEG): container finished" podID="6cf784d4-e494-4c0b-8268-08959219d444" containerID="f39d38e4628bb300788764ea38c5d3a8e39e21b3036911e9021984e7a4bfe0a3" exitCode=0 Jun 16 20:23:52.048770 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.048723 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" event={"ID":"6cf784d4-e494-4c0b-8268-08959219d444","Type":"ContainerDied","Data":"f39d38e4628bb300788764ea38c5d3a8e39e21b3036911e9021984e7a4bfe0a3"} Jun 16 20:23:52.111521 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.111501 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:52.247814 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247745 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247814 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247791 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247816 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247861 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247912 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247945 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247965 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bj8nc\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.247995 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.247988 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.248282 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248013 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo\") pod \"6cf784d4-e494-4c0b-8268-08959219d444\" (UID: \"6cf784d4-e494-4c0b-8268-08959219d444\") " Jun 16 20:23:52.248282 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248133 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:52.248282 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248217 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 20:23:52.248399 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248171 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:52.248741 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248711 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data" (OuterVolumeSpecName: "istio-data") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:52.251856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.248206 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:52.251856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.249657 2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6cf784d4-e494-4c0b-8268-08959219d444-istiod-ca-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.251856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.249683 2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-certs\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.251856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.249704 2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-workload-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.252270 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.252237 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token" (OuterVolumeSpecName: "istio-token") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:23:52.256512 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.256446 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc" (OuterVolumeSpecName: "kube-api-access-bj8nc") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "kube-api-access-bj8nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:23:52.256604 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.256527 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:23:52.257724 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.257702 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6cf784d4-e494-4c0b-8268-08959219d444" (UID: "6cf784d4-e494-4c0b-8268-08959219d444"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 16 20:23:52.350229 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350207 2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-credential-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.350229 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350227 2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-envoy\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.350351 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350237 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bj8nc\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-kube-api-access-bj8nc\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.350351 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350245 2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6cf784d4-e494-4c0b-8268-08959219d444-istio-data\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.350351 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350253 2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6cf784d4-e494-4c0b-8268-08959219d444-istio-podinfo\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:52.350351 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:52.350261 2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6cf784d4-e494-4c0b-8268-08959219d444-istio-token\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:23:53.054905 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.054875 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" Jun 16 20:23:53.055296 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.054879 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt" event={"ID":"6cf784d4-e494-4c0b-8268-08959219d444","Type":"ContainerDied","Data":"17ccc97be3fa1806a3ecb63b6c30f85fe368be8430d00f28bf76acff59383bdd"} Jun 16 20:23:53.055296 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.055037 2550 scope.go:117] "RemoveContainer" containerID="f39d38e4628bb300788764ea38c5d3a8e39e21b3036911e9021984e7a4bfe0a3" Jun 16 20:23:53.077865 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.077839 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:53.086103 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.086080 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-2cc47257-openshift-default-5fcbd666f6-42sgt"] Jun 16 20:23:53.094848 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.094827 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cf784d4-e494-4c0b-8268-08959219d444" path="/var/lib/kubelet/pods/6cf784d4-e494-4c0b-8268-08959219d444/volumes" Jun 16 20:23:53.906252 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:53.906221 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.008860 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.008789 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.092951 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.092916 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:23:54.093957 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.093929 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cf784d4-e494-4c0b-8268-08959219d444" containerName="istio-proxy" Jun 16 20:23:54.093957 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.093957 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cf784d4-e494-4c0b-8268-08959219d444" containerName="istio-proxy" Jun 16 20:23:54.094106 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.094093 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cf784d4-e494-4c0b-8268-08959219d444" containerName="istio-proxy" Jun 16 20:23:54.098889 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.098868 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.101596 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.101573 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-333cc335-openshift-default-dockercfg-2q5ks\"" Jun 16 20:23:54.110197 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.110174 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:23:54.130209 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.130169 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.231311 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.231175 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.263983 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.263957 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.263986 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56ljf\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264010 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264036 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264068 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264109 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264097 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264284 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264143 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264284 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264183 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.264284 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.264269 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.335247 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.335215 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.365549 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365522 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365672 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365554 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56ljf\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365672 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365584 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365672 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365608 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365672 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365636 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365947 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365683 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365947 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365711 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365947 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365754 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.365947 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365855 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.366151 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.365962 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.366151 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.366066 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.366151 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.366089 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.366300 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.366153 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.366536 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.366505 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.368005 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.367983 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.368121 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.368099 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.375636 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.375606 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56ljf\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.375727 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.375706 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token\") pod \"e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.411105 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.411079 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:54.430795 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.430758 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:54.556693 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.556668 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:23:54.558941 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:23:54.558914 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb852d1_8ec1_4376_9194_20f9d0573990.slice/crio-bd7a0d421dfef11bb5878517c9f538668d99ed22e5f4008e724410c87749effc WatchSource:0}: Error finding container bd7a0d421dfef11bb5878517c9f538668d99ed22e5f4008e724410c87749effc: Status 404 returned error can't find the container with id bd7a0d421dfef11bb5878517c9f538668d99ed22e5f4008e724410c87749effc Jun 16 20:23:54.561031 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.560986 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:54.561126 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.561059 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:54.561126 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:54.561085 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:23:55.068067 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:55.068031 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" event={"ID":"eeb852d1-8ec1-4376-9194-20f9d0573990","Type":"ContainerStarted","Data":"a02100c61e6c6dec6c4c354a6b08f8410450ee4a561ea238da76ca0badf698d8"} Jun 16 20:23:55.068242 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:55.068084 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" event={"ID":"eeb852d1-8ec1-4376-9194-20f9d0573990","Type":"ContainerStarted","Data":"bd7a0d421dfef11bb5878517c9f538668d99ed22e5f4008e724410c87749effc"} Jun 16 20:23:55.134344 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:55.134292 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" podStartSLOduration=1.134275763 podStartE2EDuration="1.134275763s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:23:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:23:55.133609639 +0000 UTC m=+2118.527602360" watchObservedRunningTime="2026-06-16 20:23:55.134275763 +0000 UTC m=+2118.528268531" Jun 16 20:23:55.411243 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:55.411209 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:55.415582 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:55.415558 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:56.073171 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:56.073140 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:56.074022 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:56.073999 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:23:57.375079 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:57.375047 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:59.802318 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:59.802287 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:23:59.977500 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:59.977452 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:23:59.977660 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:23:59.977640 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" podUID="eeb852d1-8ec1-4376-9194-20f9d0573990" containerName="istio-proxy" containerID="cri-o://a02100c61e6c6dec6c4c354a6b08f8410450ee4a561ea238da76ca0badf698d8" gracePeriod=30 Jun 16 20:24:00.050685 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:00.050632 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:00.113848 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:00.113816 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:01.845431 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:01.845400 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:05.123307 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.123272 2550 generic.go:356] "Generic (PLEG): container finished" podID="eeb852d1-8ec1-4376-9194-20f9d0573990" containerID="a02100c61e6c6dec6c4c354a6b08f8410450ee4a561ea238da76ca0badf698d8" exitCode=0 Jun 16 20:24:05.123683 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.123344 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" event={"ID":"eeb852d1-8ec1-4376-9194-20f9d0573990","Type":"ContainerDied","Data":"a02100c61e6c6dec6c4c354a6b08f8410450ee4a561ea238da76ca0badf698d8"} Jun 16 20:24:05.227145 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.227122 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:24:05.254196 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254133 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254196 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254171 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254397 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254211 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254397 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254250 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254397 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254278 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254397 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254302 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254397 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254331 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56ljf\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254719 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254399 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254719 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254433 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket\") pod \"eeb852d1-8ec1-4376-9194-20f9d0573990\" (UID: \"eeb852d1-8ec1-4376-9194-20f9d0573990\") " Jun 16 20:24:05.254719 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254489 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:24:05.254719 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254553 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:24:05.254935 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254782 2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-certs\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.254935 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254800 2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-workload-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.254935 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.254872 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 20:24:05.255094 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.255009 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:24:05.255685 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.255655 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data" (OuterVolumeSpecName: "istio-data") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:24:05.256913 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.256889 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf" (OuterVolumeSpecName: "kube-api-access-56ljf") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "kube-api-access-56ljf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:24:05.257090 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.257066 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 16 20:24:05.257363 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.257337 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:24:05.257493 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.257362 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token" (OuterVolumeSpecName: "istio-token") pod "eeb852d1-8ec1-4376-9194-20f9d0573990" (UID: "eeb852d1-8ec1-4376-9194-20f9d0573990"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:24:05.355187 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355153 2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-token\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355187 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355181 2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-envoy\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355187 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355191 2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-podinfo\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355422 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355199 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56ljf\" (UniqueName: \"kubernetes.io/projected/eeb852d1-8ec1-4376-9194-20f9d0573990-kube-api-access-56ljf\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355422 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355208 2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eeb852d1-8ec1-4376-9194-20f9d0573990-istiod-ca-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355422 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355217 2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-credential-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:05.355422 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:05.355225 2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eeb852d1-8ec1-4376-9194-20f9d0573990-istio-data\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:24:06.130016 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:06.129984 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" Jun 16 20:24:06.130403 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:06.129991 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth" event={"ID":"eeb852d1-8ec1-4376-9194-20f9d0573990","Type":"ContainerDied","Data":"bd7a0d421dfef11bb5878517c9f538668d99ed22e5f4008e724410c87749effc"} Jun 16 20:24:06.130403 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:06.130113 2550 scope.go:117] "RemoveContainer" containerID="a02100c61e6c6dec6c4c354a6b08f8410450ee4a561ea238da76ca0badf698d8" Jun 16 20:24:06.194266 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:06.194236 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:24:06.196920 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:06.196895 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-333cc335-openshift-default-59c999b9cd-bnhth"] Jun 16 20:24:07.095008 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:07.094976 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eeb852d1-8ec1-4376-9194-20f9d0573990" path="/var/lib/kubelet/pods/eeb852d1-8ec1-4376-9194-20f9d0573990/volumes" Jun 16 20:24:08.098063 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:08.098023 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:08.164758 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:08.164728 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:08.579020 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:08.578987 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:08.672346 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:08.672319 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:08.799947 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:08.799919 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:10.164885 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:10.164849 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:16.934286 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:16.934254 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:17.000405 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:17.000350 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:17.092233 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:17.092196 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:17.197269 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:17.197181 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:17.288780 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:17.288749 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:17.697827 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:17.697794 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:43.674264 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:43.674226 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:49.980802 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:49.980772 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:50.084745 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:50.084719 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:24:50.181279 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:24:50.181248 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:06.072359 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:06.072325 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:12.413658 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:12.413623 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:12.517527 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:12.517492 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:12.618753 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:12.618719 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:23.085127 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:23.085096 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:25.750462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:25.750427 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:30.303644 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:30.303615 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:30.418060 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:30.418031 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:30.524424 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:30.524395 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:30.625274 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:30.625243 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:31.780938 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:31.780908 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:38.315403 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:38.315369 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:38.416457 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:38.416429 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:38.519255 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:38.519222 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:38.614765 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:38.614738 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:39.764820 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:39.764787 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:39.864873 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:39.864841 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:41.122821 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:41.122757 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:46.768506 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:46.768441 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:46.866857 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:46.866829 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:48.462338 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:48.462308 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:49.105692 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:49.105657 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:49.223877 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:49.223845 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:55.975415 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:55.975339 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:56.042304 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.042270 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:56.196257 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.196230 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:25:56.196607 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.196593 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeb852d1-8ec1-4376-9194-20f9d0573990" containerName="istio-proxy" Jun 16 20:25:56.196660 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.196609 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeb852d1-8ec1-4376-9194-20f9d0573990" containerName="istio-proxy" Jun 16 20:25:56.196696 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.196685 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeb852d1-8ec1-4376-9194-20f9d0573990" containerName="istio-proxy" Jun 16 20:25:56.199690 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.199673 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.202288 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.202268 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-24730d5c-openshift-default-dockercfg-lkxqs\"" Jun 16 20:25:56.224963 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.224938 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:56.236038 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.235968 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:25:56.290588 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.290557 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:56.391541 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391501 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391541 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391542 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391560 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391577 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391668 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391704 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391725 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfj4b\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391915 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391766 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.391915 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.391829 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492671 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492586 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492671 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492622 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492671 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492639 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfj4b\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492904 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492815 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492904 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492858 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492998 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492961 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.492998 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.492990 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493107 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493022 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493107 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493046 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493389 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493443 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493456 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493689 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493501 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.493689 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.493609 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.495040 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.495022 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.495345 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.495327 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.501647 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.501622 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.502011 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.501988 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfj4b\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b\") pod \"e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.510261 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.510238 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:56.659992 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.659966 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:25:56.662657 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:25:56.662609 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod656cb879_cc74_45cc_84d4_52a7e3dbca39.slice/crio-09c7583035a0889f82f4282dcbf5c140f0220e506f8e74189eea5dc2af64520b WatchSource:0}: Error finding container 09c7583035a0889f82f4282dcbf5c140f0220e506f8e74189eea5dc2af64520b: Status 404 returned error can't find the container with id 09c7583035a0889f82f4282dcbf5c140f0220e506f8e74189eea5dc2af64520b Jun 16 20:25:56.665058 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.665022 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:25:56.665140 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.665086 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:25:56.665140 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.665115 2550 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jun 16 20:25:56.677453 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.677426 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" event={"ID":"656cb879-cc74-45cc-84d4-52a7e3dbca39","Type":"ContainerStarted","Data":"09c7583035a0889f82f4282dcbf5c140f0220e506f8e74189eea5dc2af64520b"} Jun 16 20:25:56.842634 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.842547 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:56.941232 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:56.941197 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:25:57.683135 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:57.683096 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" event={"ID":"656cb879-cc74-45cc-84d4-52a7e3dbca39","Type":"ContainerStarted","Data":"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769"} Jun 16 20:25:58.510622 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:58.510583 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:58.515849 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:58.515817 2550 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:58.539992 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:58.539928 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" podStartSLOduration=2.539909932 podStartE2EDuration="2.539909932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:25:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:25:57.721650048 +0000 UTC m=+2241.115642754" watchObservedRunningTime="2026-06-16 20:25:58.539909932 +0000 UTC m=+2241.933902638" Jun 16 20:25:58.688062 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:58.688026 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:58.688980 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:58.688963 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:25:59.742005 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:25:59.741972 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:02.672777 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:02.672742 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:02.822080 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:02.822048 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:03.106249 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:03.106162 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:09.619644 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:09.619605 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:09.721245 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:09.721212 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:10.053518 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:10.053420 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:10.431383 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:10.431347 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:16.866897 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:16.866858 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:16.936192 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:16.936158 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:16.985178 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:16.985142 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:26:16.985388 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:16.985364 2550 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" podUID="656cb879-cc74-45cc-84d4-52a7e3dbca39" containerName="istio-proxy" containerID="cri-o://91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769" gracePeriod=30 Jun 16 20:26:17.014027 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:17.013993 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:17.125098 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:17.124995 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:17.214403 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:17.214371 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:17.361425 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:17.361388 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:22.236486 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.236437 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:26:22.336747 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336719 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.336940 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336755 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.336940 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336809 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfj4b\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.336940 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336844 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.336940 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336867 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.336940 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336910 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.337234 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336961 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.337234 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.336989 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.337234 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337042 2550 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs\") pod \"656cb879-cc74-45cc-84d4-52a7e3dbca39\" (UID: \"656cb879-cc74-45cc-84d4-52a7e3dbca39\") " Jun 16 20:26:22.337234 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337073 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:26:22.337417 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337246 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data" (OuterVolumeSpecName: "istio-data") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:26:22.337417 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337303 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:26:22.337560 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337443 2550 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-data\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.337560 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337463 2550 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.337560 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337498 2550 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-credential-socket\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.337560 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337523 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:26:22.337768 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.337604 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 20:26:22.339192 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.339161 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 20:26:22.339304 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.339242 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b" (OuterVolumeSpecName: "kube-api-access-zfj4b") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "kube-api-access-zfj4b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:26:22.339304 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.339238 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 16 20:26:22.339304 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.339261 2550 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token" (OuterVolumeSpecName: "istio-token") pod "656cb879-cc74-45cc-84d4-52a7e3dbca39" (UID: "656cb879-cc74-45cc-84d4-52a7e3dbca39"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:26:22.438160 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438124 2550 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/656cb879-cc74-45cc-84d4-52a7e3dbca39-istiod-ca-cert\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.438160 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438156 2550 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-podinfo\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.438160 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438166 2550 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-envoy\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.438404 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438175 2550 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/656cb879-cc74-45cc-84d4-52a7e3dbca39-workload-certs\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.438404 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438183 2550 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-istio-token\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.438404 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.438192 2550 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfj4b\" (UniqueName: \"kubernetes.io/projected/656cb879-cc74-45cc-84d4-52a7e3dbca39-kube-api-access-zfj4b\") on node \"ip-10-0-138-253.ec2.internal\" DevicePath \"\"" Jun 16 20:26:22.803719 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.803683 2550 generic.go:356] "Generic (PLEG): container finished" podID="656cb879-cc74-45cc-84d4-52a7e3dbca39" containerID="91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769" exitCode=0 Jun 16 20:26:22.803925 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.803734 2550 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" Jun 16 20:26:22.803925 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.803774 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" event={"ID":"656cb879-cc74-45cc-84d4-52a7e3dbca39","Type":"ContainerDied","Data":"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769"} Jun 16 20:26:22.803925 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.803842 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6" event={"ID":"656cb879-cc74-45cc-84d4-52a7e3dbca39","Type":"ContainerDied","Data":"09c7583035a0889f82f4282dcbf5c140f0220e506f8e74189eea5dc2af64520b"} Jun 16 20:26:22.803925 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.803875 2550 scope.go:117] "RemoveContainer" containerID="91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769" Jun 16 20:26:22.815087 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.815069 2550 scope.go:117] "RemoveContainer" containerID="91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769" Jun 16 20:26:22.815347 ip-10-0-138-253 kubenswrapper[2550]: E0616 20:26:22.815326 2550 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769\": container with ID starting with 91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769 not found: ID does not exist" containerID="91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769" Jun 16 20:26:22.815418 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.815355 2550 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769"} err="failed to get container status \"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769\": rpc error: code = NotFound desc = could not find container \"91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769\": container with ID starting with 91426d857f93bac8dcfe70c16b96c63803c41bcfbf5acfe461292d459e3a8769 not found: ID does not exist" Jun 16 20:26:22.829098 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.829075 2550 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:26:22.833521 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:22.833499 2550 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-24730d5c-openshift-default-78466b7b46-9n2z6"] Jun 16 20:26:23.095968 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:23.095872 2550 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="656cb879-cc74-45cc-84d4-52a7e3dbca39" path="/var/lib/kubelet/pods/656cb879-cc74-45cc-84d4-52a7e3dbca39/volumes" Jun 16 20:26:23.527677 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:23.527646 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:23.852140 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:23.852044 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:23.958004 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:23.957971 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:24.057631 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:24.057589 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:24.227504 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:24.227452 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:30.605031 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:30.604992 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:30.658885 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:30.658849 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:41.083764 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:41.083730 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:41.180100 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:41.180068 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:47.254009 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:47.253975 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:48.307257 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:48.307222 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:55.038934 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:55.038898 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:55.129907 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:55.129870 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:56.077614 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:56.077570 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:56.174049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:56.174016 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:56.280269 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:56.280243 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:56.958408 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:56.958359 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:57.061106 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:57.061068 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:57.171181 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:57.171150 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:26:58.589127 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:26:58.589084 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:05.852049 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:05.851958 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:05.952596 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:05.952554 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:06.520155 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:06.520068 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:13.057591 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:13.057543 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:13.129189 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:13.129148 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:13.204446 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:13.204410 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:13.305273 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:13.305224 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:23.833133 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:23.833090 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:24.153547 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:24.153509 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:45.120555 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:45.120513 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:51.785116 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:51.785079 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:51.874887 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:51.874852 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:27:59.265822 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:27:59.265785 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4d6875-fn87r_3db7327f-0973-4f04-b3d0-3eb0415b7209/authorino/0.log" Jun 16 20:28:03.952679 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:03.952644 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56694dc9bd-ftctr_3fb82159-a6f1-427f-8023-6bc7be33a313/nginx/0.log" Jun 16 20:28:04.556237 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:04.556210 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29694015-w9gjq_8ad41df7-b542-4bed-a4a7-19ca022a4af1/cleanup/0.log" Jun 16 20:28:05.394496 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:05.394448 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-zblhd_1e4329e7-8bac-4977-87fb-2830cf250c29/copy-manifests/0.log" Jun 16 20:28:05.406541 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:05.406513 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-zblhd_1e4329e7-8bac-4977-87fb-2830cf250c29/manager/0.log" Jun 16 20:28:05.516234 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:05.516197 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-57cjr_4fd89f09-58a6-4d15-901e-d098dcebd787/postgres/0.log" Jun 16 20:28:06.791132 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:06.791102 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4d6875-fn87r_3db7327f-0973-4f04-b3d0-3eb0415b7209/authorino/0.log" Jun 16 20:28:07.250964 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:07.250937 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4mx9b_2d7488ea-bbfb-43f1-befd-ddf9b301a4e5/registry-server/0.log" Jun 16 20:28:07.367289 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:07.367248 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qzdtq_b1d606f7-c5f7-45c2-b218-117a06cead06/manager/0.log" Jun 16 20:28:07.935375 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:07.935342 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958v2tt_c5d45911-372a-4191-925e-a7913fae3e3b/istio-proxy/0.log" Jun 16 20:28:07.978080 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:07.978037 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:28:08.389523 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:08.389453 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/1.log" Jun 16 20:28:08.738399 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:08.738323 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf7bff7c4-t7mkh_ae217bed-f919-49eb-abb3-6d80b44c7486/router/0.log" Jun 16 20:28:09.681893 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:09.681867 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6cfb9f9b9c-52d8q_95639ed9-94c9-4d47-bb04-622c78d77b10/main/0.log" Jun 16 20:28:13.339856 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.339824 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:28:13.355594 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.355564 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqlq7/must-gather-qhs87"] Jun 16 20:28:13.355949 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.355936 2550 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="656cb879-cc74-45cc-84d4-52a7e3dbca39" containerName="istio-proxy" Jun 16 20:28:13.355992 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.355952 2550 state_mem.go:107] "Deleted CPUSet assignment" podUID="656cb879-cc74-45cc-84d4-52a7e3dbca39" containerName="istio-proxy" Jun 16 20:28:13.356027 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.356015 2550 memory_manager.go:368] "RemoveStaleState removing state" podUID="656cb879-cc74-45cc-84d4-52a7e3dbca39" containerName="istio-proxy" Jun 16 20:28:13.359129 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.359112 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.362076 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.362056 2550 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqlq7\"/\"default-dockercfg-mg6j4\"" Jun 16 20:28:13.362350 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.362334 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"openshift-service-ca.crt\"" Jun 16 20:28:13.363098 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.363079 2550 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"kube-root-ca.crt\"" Jun 16 20:28:13.397221 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.397197 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/must-gather-qhs87"] Jun 16 20:28:13.414800 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.414772 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzcx8\" (UniqueName: \"kubernetes.io/projected/e5ee05b8-06ca-465e-b2c5-ee06840f269c-kube-api-access-bzcx8\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.414909 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.414873 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ee05b8-06ca-465e-b2c5-ee06840f269c-must-gather-output\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.423811 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.423789 2550 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" limit=1024 Jun 16 20:28:13.516189 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.516147 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ee05b8-06ca-465e-b2c5-ee06840f269c-must-gather-output\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.516339 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.516210 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzcx8\" (UniqueName: \"kubernetes.io/projected/e5ee05b8-06ca-465e-b2c5-ee06840f269c-kube-api-access-bzcx8\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.516506 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.516460 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e5ee05b8-06ca-465e-b2c5-ee06840f269c-must-gather-output\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.536861 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.536833 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzcx8\" (UniqueName: \"kubernetes.io/projected/e5ee05b8-06ca-465e-b2c5-ee06840f269c-kube-api-access-bzcx8\") pod \"must-gather-qhs87\" (UID: \"e5ee05b8-06ca-465e-b2c5-ee06840f269c\") " pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.668319 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.668295 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/must-gather-qhs87" Jun 16 20:28:13.805658 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.805629 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/must-gather-qhs87"] Jun 16 20:28:13.807512 ip-10-0-138-253 kubenswrapper[2550]: W0616 20:28:13.807480 2550 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5ee05b8_06ca_465e_b2c5_ee06840f269c.slice/crio-a30a68f096b523f84e466a9eea79fd81cbc0d636ee53fbe56a9964a26f2de6cd WatchSource:0}: Error finding container a30a68f096b523f84e466a9eea79fd81cbc0d636ee53fbe56a9964a26f2de6cd: Status 404 returned error can't find the container with id a30a68f096b523f84e466a9eea79fd81cbc0d636ee53fbe56a9964a26f2de6cd Jun 16 20:28:13.809233 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:13.809216 2550 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 20:28:14.328487 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:14.328443 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/must-gather-qhs87" event={"ID":"e5ee05b8-06ca-465e-b2c5-ee06840f269c","Type":"ContainerStarted","Data":"a30a68f096b523f84e466a9eea79fd81cbc0d636ee53fbe56a9964a26f2de6cd"} Jun 16 20:28:15.337754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:15.337658 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/must-gather-qhs87" event={"ID":"e5ee05b8-06ca-465e-b2c5-ee06840f269c","Type":"ContainerStarted","Data":"b96f124d24098b53623f87c8897027fc6bf3e9b32e6f59305690990788d86421"} Jun 16 20:28:15.337754 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:15.337706 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/must-gather-qhs87" event={"ID":"e5ee05b8-06ca-465e-b2c5-ee06840f269c","Type":"ContainerStarted","Data":"89cbcaff56a97f52d74f33733717f653446a0db4db02d819e588ac1ab9dbefbe"} Jun 16 20:28:17.166283 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:17.166231 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-lbx28_14609d38-5cf6-4c6f-be87-f29cc29ac4e7/global-pull-secret-syncer/0.log" Jun 16 20:28:17.273452 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:17.273412 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hxjx5_33adf1cd-f0af-48f7-97f0-7b56d140e065/konnectivity-agent/0.log" Jun 16 20:28:17.500459 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:17.500392 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-253.ec2.internal_85636fa59369e3d60df062b040761869/haproxy/0.log" Jun 16 20:28:22.091543 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:22.091141 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f4d6875-fn87r_3db7327f-0973-4f04-b3d0-3eb0415b7209/authorino/0.log" Jun 16 20:28:22.308350 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:22.308302 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4mx9b_2d7488ea-bbfb-43f1-befd-ddf9b301a4e5/registry-server/0.log" Jun 16 20:28:22.415491 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:22.412667 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-qzdtq_b1d606f7-c5f7-45c2-b218-117a06cead06/manager/0.log" Jun 16 20:28:24.570386 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:24.570349 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-f9d7df769-xcrq7_b7c6e32c-259e-4921-9914-474327435dd2/cluster-monitoring-operator/0.log" Jun 16 20:28:25.079162 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:25.079119 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9xf8_41207e94-3a0d-4a2c-b81f-6340689d0c21/node-exporter/0.log" Jun 16 20:28:25.130676 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:25.130401 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9xf8_41207e94-3a0d-4a2c-b81f-6340689d0c21/kube-rbac-proxy/0.log" Jun 16 20:28:25.186840 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:25.186797 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m9xf8_41207e94-3a0d-4a2c-b81f-6340689d0c21/init-textfile/0.log" Jun 16 20:28:27.557795 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:27.557755 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-867b76cb74-9c796_6b24991b-90bd-4742-bbc7-556b574ff122/networking-console-plugin/0.log" Jun 16 20:28:28.314138 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.314102 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:28:28.319585 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.319557 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/3.log" Jun 16 20:28:28.536670 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.536601 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqlq7/must-gather-qhs87" podStartSLOduration=14.316410495 podStartE2EDuration="15.536576746s" totalImagesPullingTime="1.220166251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:28:15.372350262 +0000 UTC m=+2378.766342978" watchObservedRunningTime="2026-06-16 20:28:28.536576746 +0000 UTC m=+2391.930569452" Jun 16 20:28:28.538176 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.538143 2550 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99"] Jun 16 20:28:28.544851 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.544824 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.552794 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.552459 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99"] Jun 16 20:28:28.579103 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.578996 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-proc\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.579103 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.579089 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b95qz\" (UniqueName: \"kubernetes.io/projected/a23d5247-8207-4a7e-be16-b9dd3d113105-kube-api-access-b95qz\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.579676 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.579152 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-lib-modules\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.579676 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.579224 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-podres\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.579676 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.579341 2550 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-sys\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680502 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680432 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-podres\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680558 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-sys\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680641 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-proc\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680642 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-podres\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680704 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680666 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b95qz\" (UniqueName: \"kubernetes.io/projected/a23d5247-8207-4a7e-be16-b9dd3d113105-kube-api-access-b95qz\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680939 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680720 2550 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-lib-modules\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680939 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680747 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-proc\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680939 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680747 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-sys\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.680939 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.680885 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a23d5247-8207-4a7e-be16-b9dd3d113105-lib-modules\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.691297 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.691226 2550 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b95qz\" (UniqueName: \"kubernetes.io/projected/a23d5247-8207-4a7e-be16-b9dd3d113105-kube-api-access-b95qz\") pod \"perf-node-gather-daemonset-ntb99\" (UID: \"a23d5247-8207-4a7e-be16-b9dd3d113105\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.857578 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.857490 2550 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:28.911391 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:28.911356 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-75d55ff96b-dqk6s_f99bed43-3d1f-4d4e-a355-2eb06bec5c60/console/0.log" Jun 16 20:28:29.060750 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.060708 2550 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99"] Jun 16 20:28:29.449674 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.449563 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" event={"ID":"a23d5247-8207-4a7e-be16-b9dd3d113105","Type":"ContainerStarted","Data":"4ebc954920c54d455d02cf46dedc58e6e50fe072fb31d829c7a3f7bc1006d569"} Jun 16 20:28:29.449674 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.449635 2550 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" event={"ID":"a23d5247-8207-4a7e-be16-b9dd3d113105","Type":"ContainerStarted","Data":"859bac62b3eb6f6427467b35e2bac7699cc708b42e68adf9c75e86cb88a2869f"} Jun 16 20:28:29.450225 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.449961 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:29.470154 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.470084 2550 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" podStartSLOduration=1.470061984 podStartE2EDuration="1.470061984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 20:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:28:29.469902292 +0000 UTC m=+2392.863894998" watchObservedRunningTime="2026-06-16 20:28:29.470061984 +0000 UTC m=+2392.864054693" Jun 16 20:28:29.662894 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:29.662858 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-bd4ccd799-v9mzp_1afd746c-550b-4ba8-8763-855f76499ec9/volume-data-source-validator/0.log" Jun 16 20:28:30.959774 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:30.959746 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zr5jp_2f8f80fc-7079-472c-83de-9de737fd0b4a/dns/0.log" Jun 16 20:28:30.986857 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:30.986831 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zr5jp_2f8f80fc-7079-472c-83de-9de737fd0b4a/kube-rbac-proxy/0.log" Jun 16 20:28:31.075725 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:31.075702 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hrtjn_c0a04b50-3f53-4adb-8f5d-e417de7e35de/dns-node-resolver/0.log" Jun 16 20:28:31.689345 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:31.689303 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7d67j_856ecf31-1cc2-4d36-a00f-3a1a16b6c9c3/node-ca/0.log" Jun 16 20:28:32.892685 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:32.892657 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958v2tt_c5d45911-372a-4191-925e-a7913fae3e3b/istio-proxy/0.log" Jun 16 20:28:33.068619 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:33.068588 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/0.log" Jun 16 20:28:33.107033 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:33.106999 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/1.log" Jun 16 20:28:33.302433 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:33.302349 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf7bff7c4-t7mkh_ae217bed-f919-49eb-abb3-6d80b44c7486/router/0.log" Jun 16 20:28:34.003813 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.003776 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6d2zm_71bce5d7-8b94-4548-89c1-4b8fd80928d3/serve-healthcheck-canary/0.log" Jun 16 20:28:34.621455 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.621421 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-gcgjh_43555df0-5adb-46e0-a640-96da6ecbed9b/insights-operator/0.log" Jun 16 20:28:34.622268 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.622243 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5bbd86d6bd-gcgjh_43555df0-5adb-46e0-a640-96da6ecbed9b/insights-operator/1.log" Jun 16 20:28:34.645633 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.645608 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd8fl_8b7b97f2-abc7-4501-9d59-413a9ccb196f/kube-rbac-proxy/0.log" Jun 16 20:28:34.673330 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.673301 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd8fl_8b7b97f2-abc7-4501-9d59-413a9ccb196f/exporter/0.log" Jun 16 20:28:34.701099 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:34.701063 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kd8fl_8b7b97f2-abc7-4501-9d59-413a9ccb196f/extractor/0.log" Jun 16 20:28:35.472580 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:35.472554 2550 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-ntb99" Jun 16 20:28:37.295931 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.295896 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:28:37.296710 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.296680 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-5dbbb5d744-r6tp8_8a2d9f6f-ac73-4b77-80b7-af46215799ca/console-operator/2.log" Jun 16 20:28:37.301816 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.301794 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:28:37.302080 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.302004 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-94ss8_dfc5e889-c0a5-4b6f-b6fb-242a999f1f64/ovn-acl-logging/0.log" Jun 16 20:28:37.420435 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.420405 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56694dc9bd-ftctr_3fb82159-a6f1-427f-8023-6bc7be33a313/nginx/0.log" Jun 16 20:28:37.622274 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:37.622241 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29694015-w9gjq_8ad41df7-b542-4bed-a4a7-19ca022a4af1/cleanup/0.log" Jun 16 20:28:38.179761 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:38.179674 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-zblhd_1e4329e7-8bac-4977-87fb-2830cf250c29/manager/0.log" Jun 16 20:28:38.210724 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:38.210627 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-zblhd_1e4329e7-8bac-4977-87fb-2830cf250c29/copy-manifests/0.log" Jun 16 20:28:38.245819 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:38.245783 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-57cjr_4fd89f09-58a6-4d15-901e-d098dcebd787/postgres/0.log" Jun 16 20:28:39.979639 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:39.979596 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7ff6468978-rmk2j_1c9f32ec-21a4-43c6-9850-eb45651f5e33/manager/0.log" Jun 16 20:28:41.941267 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:41.941233 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958v2tt_c5d45911-372a-4191-925e-a7913fae3e3b/istio-proxy/0.log" Jun 16 20:28:42.077258 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:42.077227 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/0.log" Jun 16 20:28:42.115749 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:42.115718 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/1.log" Jun 16 20:28:42.213548 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:42.213418 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf7bff7c4-t7mkh_ae217bed-f919-49eb-abb3-6d80b44c7486/router/0.log" Jun 16 20:28:43.325006 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:43.324972 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958v2tt_c5d45911-372a-4191-925e-a7913fae3e3b/istio-proxy/0.log" Jun 16 20:28:43.494792 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:43.494763 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/0.log" Jun 16 20:28:43.537825 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:43.537795 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/1.log" Jun 16 20:28:43.691042 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:43.691017 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf7bff7c4-t7mkh_ae217bed-f919-49eb-abb3-6d80b44c7486/router/0.log" Jun 16 20:28:45.488333 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.488299 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f97958v2tt_c5d45911-372a-4191-925e-a7913fae3e3b/istio-proxy/0.log" Jun 16 20:28:45.612685 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.612657 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/0.log" Jun 16 20:28:45.652641 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.652568 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-sfnlq_eb5d4452-f6b8-45d6-8574-11c75db1faaa/istio-proxy/1.log" Jun 16 20:28:45.770664 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.770581 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7cf7bff7c4-t7mkh_ae217bed-f919-49eb-abb3-6d80b44c7486/router/0.log" Jun 16 20:28:45.913062 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.913035 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-r42rw_4ac29a92-177c-45dd-8eed-1b3f7ae3e948/migrator/0.log" Jun 16 20:28:45.941462 ip-10-0-138-253 kubenswrapper[2550]: I0616 20:28:45.941435 2550 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-r42rw_4ac29a92-177c-45dd-8eed-1b3f7ae3e948/graceful-termination/0.log"