Jun 05 14:08:15.882231 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 05 14:08:15.882243 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 05 14:08:15.882252 ip-10-0-141-39 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 05 14:08:15.882408 ip-10-0-141-39 systemd[1]: Failed to start Kubernetes Kubelet. Jun 05 14:08:25.897865 ip-10-0-141-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 05 14:08:25.897881 ip-10-0-141-39 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dc126a88d5184abd9b37c1bea29acd8d -- Jun 05 14:10:55.580511 ip-10-0-141-39 systemd[1]: Starting Kubernetes Kubelet... Jun 05 14:10:55.964140 ip-10-0-141-39 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 14:10:55.964140 ip-10-0-141-39 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 14:10:55.964140 ip-10-0-141-39 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 14:10:55.964140 ip-10-0-141-39 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 14:10:55.964140 ip-10-0-141-39 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 14:10:55.964883 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.964229 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971134 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971156 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971160 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971163 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971166 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971169 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971172 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.971164 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971175 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971178 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971181 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971184 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971186 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971189 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971193 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971211 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971214 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971217 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971219 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971223 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971226 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971228 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971231 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971235 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971239 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971252 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971255 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971258 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.971457 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971260 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971263 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971266 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971268 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971271 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971273 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971276 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971279 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971281 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971284 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971287 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971290 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971292 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971295 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971300 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971303 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971306 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971308 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971311 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971313 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.971958 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971316 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971318 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971321 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971324 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971327 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971329 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971332 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971335 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971339 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971342 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971344 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971347 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971350 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971352 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971355 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971357 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971360 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971364 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971369 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971372 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.972462 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971375 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971378 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971381 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971384 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971387 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971389 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971393 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971396 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971399 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971402 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971405 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971408 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971411 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971413 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971416 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971419 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971422 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971426 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971429 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.972947 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971432 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971435 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971438 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971441 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971443 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971446 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971449 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971451 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971454 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971457 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971459 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971463 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.971465 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972189 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972215 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972219 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972222 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972225 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972227 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972231 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.973455 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972233 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972236 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972239 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972242 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972245 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972248 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972252 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972256 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972259 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972262 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972266 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972270 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972273 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972276 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972279 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972281 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972283 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972286 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972289 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.973979 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972291 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972294 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972296 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972299 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972301 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972304 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972306 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972309 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972312 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972315 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972317 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972321 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972325 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972328 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972331 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972334 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972337 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972340 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972343 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972345 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.974475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972348 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972350 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972353 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972356 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972360 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972362 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972365 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972367 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972370 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972372 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972375 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972377 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972380 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972383 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972385 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972388 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972390 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972393 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972396 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972398 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.974965 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972401 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972403 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972406 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972408 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972412 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972415 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972418 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972421 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972423 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972426 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972428 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972431 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972433 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972435 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972438 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972441 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972443 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972447 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972449 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972452 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.975469 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972454 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972457 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972460 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972462 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972465 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972468 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972471 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972473 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972476 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972478 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972481 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972484 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972486 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972867 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972871 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972878 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972881 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972884 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972887 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972890 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.975986 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972892 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972895 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972898 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972901 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972903 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972906 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972908 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972911 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972914 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972920 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972923 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972926 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972928 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972931 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972934 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972937 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972939 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972942 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972946 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972950 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.976475 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972953 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972956 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972959 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972961 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972964 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972966 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972969 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972973 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972975 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972978 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972980 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972983 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972991 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972994 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972996 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.972999 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973001 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973004 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973006 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973009 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.976959 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973012 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973014 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973017 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973019 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973022 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973026 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973029 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973031 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973034 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973037 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973039 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973042 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973044 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973047 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973049 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973052 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973054 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973057 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973060 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.977512 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973064 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973067 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973070 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973072 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973075 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973077 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973080 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973082 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973084 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973087 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973089 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973092 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973094 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973098 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973103 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973106 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973112 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973115 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973121 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.977969 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973123 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973126 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973128 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973131 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973134 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973136 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973139 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973141 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973144 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973146 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973149 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973151 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973154 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973158 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973242 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973250 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973256 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973260 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973265 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973268 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973272 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 14:10:55.978494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973276 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973279 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973283 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973287 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973290 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973293 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973296 2575 flags.go:64] FLAG: --cgroup-root="" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973299 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973302 2575 flags.go:64] FLAG: --client-ca-file="" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973306 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973310 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973314 2575 flags.go:64] FLAG: --cluster-domain="" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973317 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973320 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973323 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973327 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973330 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973333 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973336 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973340 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973343 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973346 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973348 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973352 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 14:10:55.979020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973356 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973360 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973363 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973365 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973368 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973371 2575 flags.go:64] FLAG: --enable-server="true" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973374 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973378 2575 flags.go:64] FLAG: --event-burst="100" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973381 2575 flags.go:64] FLAG: --event-qps="50" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973384 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973387 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973390 2575 flags.go:64] FLAG: --eviction-hard="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973394 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973396 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973399 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973402 2575 flags.go:64] FLAG: --eviction-soft="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973405 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973408 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973415 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973418 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973421 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973424 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973427 2575 flags.go:64] FLAG: --feature-gates="" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973431 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973434 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 14:10:55.979598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973437 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973440 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973443 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973446 2575 flags.go:64] FLAG: --help="false" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973449 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-141-39.ec2.internal" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973452 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973455 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973459 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973463 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973466 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973469 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973472 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973475 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973477 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973480 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973484 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973487 2575 flags.go:64] FLAG: --kube-reserved="" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973490 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973493 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973496 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973498 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973501 2575 flags.go:64] FLAG: --lock-file="" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973504 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973507 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 14:10:55.980272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973510 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973516 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973519 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973522 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973525 2575 flags.go:64] FLAG: --logging-format="text" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973528 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973531 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973534 2575 flags.go:64] FLAG: --manifest-url="" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973537 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973541 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973544 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973548 2575 flags.go:64] FLAG: --max-pods="110" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973551 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973554 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973557 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973561 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973564 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973567 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973570 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973577 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973580 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973583 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973585 2575 flags.go:64] FLAG: --pod-cidr="" Jun 05 14:10:55.980862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973588 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973594 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973596 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973599 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973602 2575 flags.go:64] FLAG: --port="10250" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973605 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973608 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e8c390c9e02d03f6" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973611 2575 flags.go:64] FLAG: --qos-reserved="" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973614 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973617 2575 flags.go:64] FLAG: --register-node="true" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973620 2575 flags.go:64] FLAG: --register-with-taints="" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973624 2575 flags.go:64] FLAG: --registry-burst="10" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973627 2575 flags.go:64] FLAG: --registry-qps="5" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973630 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973633 2575 flags.go:64] FLAG: --reserved-memory="" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973637 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973640 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973643 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973646 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973648 2575 flags.go:64] FLAG: --runonce="false" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973651 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973654 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973657 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973660 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973662 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973666 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 14:10:55.981435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973669 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973672 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973675 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973678 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973680 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973683 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973686 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973689 2575 flags.go:64] FLAG: --system-cgroups="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973692 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973696 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973699 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973702 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973706 2575 flags.go:64] FLAG: --tls-min-version="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973709 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973711 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973714 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973717 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973720 2575 flags.go:64] FLAG: --v="2" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973725 2575 flags.go:64] FLAG: --version="false" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973729 2575 flags.go:64] FLAG: --vmodule="" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973733 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.973736 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973854 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973858 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.982062 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973861 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973864 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973867 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973869 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973872 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973875 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973877 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973880 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973882 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973886 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973890 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973893 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973895 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973898 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973900 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973903 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973906 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973908 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973911 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.982644 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973913 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973916 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973918 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973921 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973924 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973926 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973928 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973931 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973933 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973936 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973939 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973941 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973944 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973946 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973949 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973951 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973954 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973957 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973959 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973962 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.983114 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973964 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973967 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973970 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973972 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973975 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973977 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973980 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973982 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973985 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973988 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973991 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973993 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973996 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.973998 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974001 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974004 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974010 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974014 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974018 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974021 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.983611 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974023 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974026 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974029 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974033 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974036 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974039 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974042 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974045 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974048 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974050 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974053 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974056 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974060 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974062 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974065 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974068 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974071 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974073 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974076 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974078 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.984108 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974081 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974084 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974086 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974089 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974091 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974094 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974096 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974099 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974102 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974105 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974107 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974110 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974112 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974115 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974117 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974121 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974123 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.984606 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.974126 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.974635 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.981298 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.981407 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.981424 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.981433 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981491 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981496 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981499 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981502 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981506 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981509 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981512 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981515 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.985021 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981518 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981521 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981524 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981527 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981529 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981532 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981536 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981540 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981543 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981546 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981549 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981552 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981554 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981557 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981560 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981563 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981566 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981569 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981571 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.985389 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981574 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981576 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981581 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981584 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981587 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981590 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981592 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981595 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981598 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981600 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981603 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981606 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981608 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981611 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981613 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981616 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981618 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981621 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981624 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981626 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.985856 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981629 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981632 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981635 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981637 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981640 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981642 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981645 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981648 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981652 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981655 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981658 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981661 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981664 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981667 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981670 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981673 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981675 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981678 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981680 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981683 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.986351 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981685 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981688 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981690 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981693 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981695 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981698 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981701 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981703 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981706 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981709 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981713 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981715 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981718 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981720 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981723 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981725 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981728 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981730 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981733 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981736 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.986841 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981738 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981741 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981743 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981746 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981749 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981752 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981754 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981757 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981760 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981763 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981766 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981768 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.981773 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981886 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981890 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 14:10:55.987331 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981893 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981896 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981898 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981901 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981903 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981906 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981909 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981911 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981914 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981916 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981919 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981921 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981924 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981926 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981929 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981932 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981935 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981937 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981940 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981942 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 14:10:55.987698 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981945 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981947 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981950 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981952 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981955 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981957 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981961 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981964 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981966 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981969 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981972 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981974 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981976 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981979 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981982 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981984 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981987 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981989 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981991 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 14:10:55.988188 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981994 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981997 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.981999 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982003 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982007 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982010 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982013 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982015 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982019 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982023 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982026 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982028 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982031 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982033 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982036 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982038 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982042 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982046 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982048 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 14:10:55.988655 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982051 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982054 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982057 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982059 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982062 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982064 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982067 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982070 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982073 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982076 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982078 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982081 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982083 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982086 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982091 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982094 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982096 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982099 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982101 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982104 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 14:10:55.989130 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982106 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982109 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982112 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982114 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982117 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982119 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982122 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982124 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982127 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982130 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982132 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982135 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982138 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982140 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982144 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982146 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982149 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982151 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 14:10:55.989624 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:55.982153 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.982158 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.982275 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.985035 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.986288 2575 server.go:1019] "Starting client certificate rotation" Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.986379 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.986409 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 14:10:55.990055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.988803 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 14:10:55.993853 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:55.993831 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 14:10:56.006373 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.006354 2575 log.go:25] "Validated CRI v1 runtime API" Jun 05 14:10:56.009335 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.009319 2575 log.go:25] "Validated CRI v1 image API" Jun 05 14:10:56.010210 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.010180 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 14:10:56.014522 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.014498 2575 fs.go:135] Filesystem UUIDs: map[27cad0f5-3977-4897-82c7-51a432a46b02:/dev/nvme0n1p4 50026498-c5c0-4c64-91af-4d8955d99797:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 05 14:10:56.014596 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.014520 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 14:10:56.019652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.019493 2575 manager.go:216] Machine: {Timestamp:2026-06-05 14:10:56.018291832 +0000 UTC m=+0.321074315 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093692 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2af3a2b7bcef95b7a69c9a970d971c SystemUUID:ec2af3a2-b7bc-ef95-b7a6-9c9a970d971c BootID:dc126a88-d518-4abd-9b37-c1bea29acd8d Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:de:ff:b3:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:de:ff:b3:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:36:16:f9:cc:9f:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 14:10:56.019652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.019644 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 14:10:56.019825 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.019806 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 14:10:56.022699 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.022674 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 14:10:56.022872 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.022702 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 14:10:56.023421 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.023409 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 14:10:56.023491 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.023426 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 14:10:56.023491 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.023442 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 14:10:56.024073 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.024059 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 14:10:56.024911 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.024900 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 14:10:56.025964 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.025944 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 14:10:56.027677 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027664 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 05 14:10:56.027819 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027808 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 14:10:56.027888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027852 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 05 14:10:56.027888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027873 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 14:10:56.027888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027887 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 14:10:56.028020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027917 2575 kubelet.go:398] "Adding apiserver pod source" Jun 05 14:10:56.028020 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.027931 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 14:10:56.028306 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.028292 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 14:10:56.028365 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.028315 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 14:10:56.030476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.030457 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 14:10:56.031898 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.031885 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 14:10:56.031944 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.031915 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 14:10:56.033078 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033064 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033085 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033094 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033102 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033113 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033118 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033126 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033131 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033138 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 14:10:56.033143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033144 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 14:10:56.033410 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033157 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 14:10:56.033410 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033163 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 14:10:56.033992 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033983 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 14:10:56.033992 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.033992 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 14:10:56.037490 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.037477 2575 server.go:1268] "Started kubelet" Jun 05 14:10:56.037607 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.037583 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 14:10:56.037913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.037730 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 14:10:56.037913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.037852 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 14:10:56.041721 ip-10-0-141-39 systemd[1]: Started Kubernetes Kubelet. Jun 05 14:10:56.043057 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.041816 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 14:10:56.043057 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.042407 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 14:10:56.043057 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.042868 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 14:10:56.043324 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.043103 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 14:10:56.043600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.043466 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 05 14:10:56.046003 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.045982 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 14:10:56.047899 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.047051 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-39.ec2.internal.18b634b551c8cc23 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-39.ec2.internal,UID:ip-10-0-141-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-39.ec2.internal,},FirstTimestamp:2026-06-05 14:10:56.037448739 +0000 UTC m=+0.340231224,LastTimestamp:2026-06-05 14:10:56.037448739 +0000 UTC m=+0.340231224,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-39.ec2.internal,}" Jun 05 14:10:56.049065 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049044 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 14:10:56.049065 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049047 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 14:10:56.049227 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.049125 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.049940 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049922 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 14:10:56.050048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049927 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 14:10:56.050048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049960 2575 factory.go:55] Registering systemd factory Jun 05 14:10:56.050048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049969 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 14:10:56.050048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049985 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 14:10:56.050048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.049971 2575 factory.go:223] Registration of the systemd container factory successfully Jun 05 14:10:56.050270 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050108 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 05 14:10:56.050270 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050117 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 05 14:10:56.050374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050319 2575 factory.go:153] Registering CRI-O factory Jun 05 14:10:56.050374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050329 2575 factory.go:223] Registration of the crio container factory successfully Jun 05 14:10:56.050374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050347 2575 factory.go:103] Registering Raw factory Jun 05 14:10:56.050374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050356 2575 manager.go:1196] Started watching for new ooms in manager Jun 05 14:10:56.050639 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.050626 2575 manager.go:349] Starting recovery of all containers Jun 05 14:10:56.057629 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.057479 2575 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 14:10:56.057629 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.057502 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 14:10:56.060944 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.060889 2575 manager.go:354] Recovery completed Jun 05 14:10:56.065097 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.065083 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.066963 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.066941 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.067035 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.066980 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.067035 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.066993 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.067930 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.067916 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 14:10:56.067930 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.067928 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 14:10:56.068055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.067945 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 05 14:10:56.068055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.067929 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.068676 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.068662 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.068731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.068689 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.068731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.068699 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.069137 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.069126 2575 policy_none.go:49] "None policy: Start" Jun 05 14:10:56.069170 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.069142 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 14:10:56.069170 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.069152 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 14:10:56.069485 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.069471 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bz96x" Jun 05 14:10:56.070130 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.070120 2575 policy_none.go:47] "Start" Jun 05 14:10:56.077181 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.077109 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-39.ec2.internal.18b634b5538b2793 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-39.ec2.internal,UID:ip-10-0-141-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-39.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-39.ec2.internal,},FirstTimestamp:2026-06-05 14:10:56.066963347 +0000 UTC m=+0.369745830,LastTimestamp:2026-06-05 14:10:56.066963347 +0000 UTC m=+0.369745830,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-39.ec2.internal,}" Jun 05 14:10:56.077498 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.077481 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bz96x" Jun 05 14:10:56.079436 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.079375 2575 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-39.ec2.internal.18b634b5538b826d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-39.ec2.internal,UID:ip-10-0-141-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-141-39.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-141-39.ec2.internal,},FirstTimestamp:2026-06-05 14:10:56.066986605 +0000 UTC m=+0.369769088,LastTimestamp:2026-06-05 14:10:56.066986605 +0000 UTC m=+0.369769088,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-39.ec2.internal,}" Jun 05 14:10:56.105976 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.105961 2575 manager.go:337] "Starting Device Plugin manager" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.106017 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106027 2575 server.go:87] "Starting device plugin registration server" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106300 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106314 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106411 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106492 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.106500 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.107301 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.107343 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.119322 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.120550 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.120595 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.120617 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 14:10:56.121281 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.120692 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 14:10:56.122485 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.122467 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:56.206706 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.206683 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.207685 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.207670 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.207772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.207699 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.207772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.207709 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.207772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.207732 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.216250 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.216231 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.216335 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.216253 2575 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-39.ec2.internal\": node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.221055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.221035 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal"] Jun 05 14:10:56.221147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.221107 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.222773 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.222759 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.222847 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.222786 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.222847 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.222797 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.223996 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.223982 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.224090 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.224131 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224114 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.224625 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224608 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.224697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224638 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.224697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224648 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.224697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224615 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.224697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224683 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.224697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.224697 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.225903 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.225889 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.225983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.225912 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:56.226571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.226556 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:56.226634 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.226580 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:56.226634 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.226591 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:56.244353 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.244329 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.255888 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.255859 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-39.ec2.internal\" not found" node="ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.260396 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.260380 2575 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-39.ec2.internal\" not found" node="ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.344772 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.344694 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.351712 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.351691 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5cf065bc1451597f31ffcaf868f9a3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"b5cf065bc1451597f31ffcaf868f9a3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.351808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.351720 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.351808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.351740 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.445577 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.445543 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.451947 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.451923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5cf065bc1451597f31ffcaf868f9a3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"b5cf065bc1451597f31ffcaf868f9a3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.452010 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.451960 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.452010 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.451978 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.452076 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.452016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5cf065bc1451597f31ffcaf868f9a3f-config\") pod \"kube-apiserver-proxy-ip-10-0-141-39.ec2.internal\" (UID: \"b5cf065bc1451597f31ffcaf868f9a3f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.452076 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.452024 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.452138 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.452021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef79c930afce4520cd954c5aeb9fd0a5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal\" (UID: \"ef79c930afce4520cd954c5aeb9fd0a5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.546394 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.546340 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.559903 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.559860 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.564593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.564574 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:56.647328 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.647244 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.747837 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.747802 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.848299 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.848266 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.948839 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:56.948799 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:56.962570 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.962541 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:56.985479 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.985448 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 14:10:56.986067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.985580 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 14:10:56.986067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:56.985607 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 14:10:57.021396 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:57.021364 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cf065bc1451597f31ffcaf868f9a3f.slice/crio-ebda2d4a9f69ae57122a76c6ae856afb55ecd002ae9c0b60ed946e30a3ed9ae0 WatchSource:0}: Error finding container ebda2d4a9f69ae57122a76c6ae856afb55ecd002ae9c0b60ed946e30a3ed9ae0: Status 404 returned error can't find the container with id ebda2d4a9f69ae57122a76c6ae856afb55ecd002ae9c0b60ed946e30a3ed9ae0 Jun 05 14:10:57.021639 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:57.021623 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef79c930afce4520cd954c5aeb9fd0a5.slice/crio-4e0c2d78a17473aa92be845f27b498b79f50e6557c73a6237fb95888186d32d7 WatchSource:0}: Error finding container 4e0c2d78a17473aa92be845f27b498b79f50e6557c73a6237fb95888186d32d7: Status 404 returned error can't find the container with id 4e0c2d78a17473aa92be845f27b498b79f50e6557c73a6237fb95888186d32d7 Jun 05 14:10:57.026613 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.026591 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:10:57.049324 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.049155 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.079564 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.079521 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 14:05:56 +0000 UTC" deadline="2028-01-22 22:52:40.797744385 +0000 UTC" Jun 05 14:10:57.079564 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.079562 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14312h41m43.718186087s" Jun 05 14:10:57.114810 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.114785 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 14:10:57.115810 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.115795 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientMemory" Jun 05 14:10:57.115888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.115826 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 14:10:57.115888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.115841 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeHasSufficientPID" Jun 05 14:10:57.124167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.124101 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"ef79c930afce4520cd954c5aeb9fd0a5","Type":"ContainerStarted","Data":"4e0c2d78a17473aa92be845f27b498b79f50e6557c73a6237fb95888186d32d7"} Jun 05 14:10:57.125045 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.125026 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" event={"ID":"b5cf065bc1451597f31ffcaf868f9a3f","Type":"ContainerStarted","Data":"ebda2d4a9f69ae57122a76c6ae856afb55ecd002ae9c0b60ed946e30a3ed9ae0"} Jun 05 14:10:57.149605 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.149580 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.250075 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.250006 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.350519 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.350485 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.450984 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.450940 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.490048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.490016 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:57.551921 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:57.551829 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-39.ec2.internal\" not found" Jun 05 14:10:57.562902 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.562871 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:57.650334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.650154 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" Jun 05 14:10:57.660581 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.660552 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 14:10:57.661705 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.661504 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" Jun 05 14:10:57.673380 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:57.673354 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 14:10:58.029542 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.029455 2575 apiserver.go:52] "Watching apiserver" Jun 05 14:10:58.038435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.038405 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 14:10:58.038823 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.038790 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-dpbd5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal","openshift-multus/network-metrics-daemon-2flc8","openshift-network-diagnostics/network-check-target-9p67f","openshift-network-operator/iptables-alerter-zj8lm","openshift-ovn-kubernetes/ovnkube-node-xl795","kube-system/konnectivity-agent-c9s84","kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g","openshift-cluster-node-tuning-operator/tuned-4rbnz","openshift-image-registry/node-ca-sqk5n","openshift-multus/multus-additional-cni-plugins-pktvn","openshift-multus/multus-zhhms","kube-system/global-pull-secret-syncer-jsrrq"] Jun 05 14:10:58.040254 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.040227 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.040628 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.040601 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:58.041509 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.041492 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.042821 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.042798 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.042922 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.042873 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:10:58.043954 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.043932 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:10:58.044062 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.044012 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:10:58.044381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.044189 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6p4rb\"" Jun 05 14:10:58.044381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.044265 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 14:10:58.044381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.044298 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 14:10:58.045130 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045114 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.045231 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045222 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-95j57\"" Jun 05 14:10:58.045299 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045289 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.045373 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045221 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 14:10:58.045518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045354 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 14:10:58.045605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.045548 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.046683 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.046665 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.048103 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.048080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 14:10:58.048209 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.048109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.048297 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.048194 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.048427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.048409 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.048490 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.048463 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r7v82\"" Jun 05 14:10:58.049285 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.049250 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 14:10:58.050259 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.050243 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.050640 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.050623 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.050730 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.050702 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 14:10:58.050833 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.050629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 14:10:58.050925 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.050836 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cvrzb\"" Jun 05 14:10:58.051091 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051072 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 14:10:58.051186 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051119 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.051186 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051125 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.051320 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051073 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 14:10:58.051320 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051312 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.051420 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051388 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ljlsc\"" Jun 05 14:10:58.051471 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.051425 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 14:10:58.052532 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.052514 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.052957 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.052940 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kjm6v\"" Jun 05 14:10:58.053067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.053049 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.053415 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.053119 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:10:58.053415 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.053266 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.055009 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.054732 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.057163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.057033 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.057163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.057102 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-khksp\"" Jun 05 14:10:58.057330 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.057295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.057375 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.057345 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.058755 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.058736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.059759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.059593 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 14:10:58.059759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.059653 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 14:10:58.059759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.059593 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 14:10:58.059759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.059718 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-glnqj\"" Jun 05 14:10:58.060885 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.060864 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 14:10:58.061291 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061270 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.061373 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061307 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m797j\" (UniqueName: \"kubernetes.io/projected/f5bf7c05-0c41-4323-9d35-d5d1e416baea-kube-api-access-m797j\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.061426 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.061426 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061418 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-system-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.061519 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-multus-certs\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.061519 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-systemd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.061652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061580 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zbdkn\"" Jun 05 14:10:58.061652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-socket-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.061652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-sys-fs\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.061781 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdd4cf1-9bbc-4949-877f-2f14852b404f-tmp-dir\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.061781 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-cnibin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.061781 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-socket-dir-parent\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.061919 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-kubelet\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.061919 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061878 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 14:10:58.062007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061922 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 14:10:58.062007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061928 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fdd4cf1-9bbc-4949-877f-2f14852b404f-hosts-file\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.062007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061964 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69c71f3-39de-44ba-880f-95f042bf0e23-konnectivity-ca\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.062007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.061994 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-netns\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062170 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062099 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-config\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062170 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062130 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:10:58.062265 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062183 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-kubelet-config\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.062265 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjtgr\" (UniqueName: \"kubernetes.io/projected/46da1f68-eb61-4a3e-9362-aa423cd81ce8-kube-api-access-qjtgr\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062341 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-netns\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.062341 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062303 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-slash\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062341 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062334 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062474 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062379 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-ovn\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062474 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062436 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4khr\" (UniqueName: \"kubernetes.io/projected/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kube-api-access-w4khr\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.062571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-cni-binary-copy\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.062571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-k8s-cni-cncf-io\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.062667 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062591 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-etc-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062667 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062623 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-device-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.062667 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062650 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnh7b\" (UniqueName: \"kubernetes.io/projected/3fdd4cf1-9bbc-4949-877f-2f14852b404f-kube-api-access-wnh7b\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.062808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dbeca93-1c17-4494-b680-0cb718fcb494-host-slash\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.062808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4q7sl\" (UniqueName: \"kubernetes.io/projected/4dbeca93-1c17-4494-b680-0cb718fcb494-kube-api-access-4q7sl\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.062808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-hostroot\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.062808 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062796 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-log-socket\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062985 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062820 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062985 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062890 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovn-node-metrics-cert\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.062985 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062923 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.062985 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062961 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-kubelet\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.062996 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-etc-kubernetes\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-var-lib-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063068 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-bin\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-script-lib\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063124 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-multus\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063166 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-os-release\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-bin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063264 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-systemd-units\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dbeca93-1c17-4494-b680-0cb718fcb494-iptables-alerter-script\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.063407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69c71f3-39de-44ba-880f-95f042bf0e23-agent-certs\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.063710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-daemon-config\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063593 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-node-log\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063658 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-registration-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.063710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063690 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-conf-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp99k\" (UniqueName: \"kubernetes.io/projected/678706a8-cc82-4819-89c9-4067aa0d2dd6-kube-api-access-dp99k\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.063999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-netd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063783 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-env-overrides\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.063999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.063842 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-dbus\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.134485 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.134458 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc54r" Jun 05 14:10:58.141902 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.141878 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zc54r" Jun 05 14:10:58.151080 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.151055 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 14:10:58.164234 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164189 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-socket-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.164363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-sys-fs\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.164363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164276 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdd4cf1-9bbc-4949-877f-2f14852b404f-tmp-dir\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.164363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164301 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-lib-modules\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.164363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-cnibin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.164363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164345 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-socket-dir-parent\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164359 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-socket-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-sys-fs\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-socket-dir-parent\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164419 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-cnibin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164468 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-kubelet\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164496 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-host\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164536 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-kubelet\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164537 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s8lw\" (UniqueName: \"kubernetes.io/projected/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-kube-api-access-4s8lw\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164579 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-systemd\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.164605 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164607 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164631 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scf92\" (UniqueName: \"kubernetes.io/projected/04b7bec0-4068-4125-80f8-89c2533591fe-kube-api-access-scf92\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164633 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fdd4cf1-9bbc-4949-877f-2f14852b404f-tmp-dir\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164687 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fdd4cf1-9bbc-4949-877f-2f14852b404f-hosts-file\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164719 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69c71f3-39de-44ba-880f-95f042bf0e23-konnectivity-ca\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164745 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-netns\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-config\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164796 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3fdd4cf1-9bbc-4949-877f-2f14852b404f-hosts-file\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-netns\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164798 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-kubelet-config\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-kubernetes\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164918 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-sys\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjtgr\" (UniqueName: \"kubernetes.io/projected/46da1f68-eb61-4a3e-9362-aa423cd81ce8-kube-api-access-qjtgr\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-kubelet-config\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.164968 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-var-lib-kubelet\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.165038 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165024 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-os-release\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-netns\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165074 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-slash\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165098 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165119 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-ovn\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-netns\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165144 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4khr\" (UniqueName: \"kubernetes.io/projected/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kube-api-access-w4khr\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-ovn\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165187 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-slash\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165209 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-serviceca\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165344 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f69c71f3-39de-44ba-880f-95f042bf0e23-konnectivity-ca\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165364 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-config\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165353 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-cni-binary-copy\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165425 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-k8s-cni-cncf-io\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165447 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-etc-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.165734 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165483 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-etc-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-k8s-cni-cncf-io\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165518 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-device-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165543 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnh7b\" (UniqueName: \"kubernetes.io/projected/3fdd4cf1-9bbc-4949-877f-2f14852b404f-kube-api-access-wnh7b\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dbeca93-1c17-4494-b680-0cb718fcb494-host-slash\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165594 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4q7sl\" (UniqueName: \"kubernetes.io/projected/4dbeca93-1c17-4494-b680-0cb718fcb494-kube-api-access-4q7sl\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165620 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-hostroot\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165643 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4dbeca93-1c17-4494-b680-0cb718fcb494-host-slash\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165644 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-log-socket\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165699 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-hostroot\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165716 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovn-node-metrics-cert\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165739 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-log-socket\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165740 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165621 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-device-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-run-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.165826 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:10:58.166506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165865 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-run\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.165884 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:10:58.665862224 +0000 UTC m=+2.968644719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165917 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-cni-binary-copy\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-kubelet\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.165987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-etc-kubernetes\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-var-lib-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166033 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-bin\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166058 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-var-lib-openvswitch\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166058 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-script-lib\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166069 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-etc-kubernetes\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-multus\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166036 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-kubelet\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166085 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-bin\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166116 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-os-release\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166100 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166146 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-multus\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.167271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166178 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-bin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-systemd-units\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166181 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-os-release\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-var-lib-cni-bin\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166242 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dbeca93-1c17-4494-b680-0cb718fcb494-iptables-alerter-script\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166268 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-host\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166274 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-systemd-units\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166343 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166365 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-cnibin\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166406 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166416 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69c71f3-39de-44ba-880f-95f042bf0e23-agent-certs\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166478 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-conf\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.168048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166513 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-daemon-config\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovnkube-script-lib\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-node-log\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-registration-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166685 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-registration-dir\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysconfig\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166754 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-node-log\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-tuned\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-conf-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166848 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp99k\" (UniqueName: \"kubernetes.io/projected/678706a8-cc82-4819-89c9-4067aa0d2dd6-kube-api-access-dp99k\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166903 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-conf-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.166956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-netd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-env-overrides\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167154 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-host-cni-netd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167213 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-dbus\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167231 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4dbeca93-1c17-4494-b680-0cb718fcb494-iptables-alerter-script\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.168737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167269 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ccbf197b-a176-4924-9ae5-35874a6c456a-dbus\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167323 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-modprobe-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.167379 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m797j\" (UniqueName: \"kubernetes.io/projected/f5bf7c05-0c41-4323-9d35-d5d1e416baea-kube-api-access-m797j\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.167494 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:10:58.667446039 +0000 UTC m=+2.970228510 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/46da1f68-eb61-4a3e-9362-aa423cd81ce8-env-overrides\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167612 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167652 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-tmp\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167670 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167687 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hds7f\" (UniqueName: \"kubernetes.io/projected/fd4d53b1-a743-4a54-be7f-7869b233ccc9-kube-api-access-hds7f\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167718 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-system-cni-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167751 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-system-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167799 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-system-cni-dir\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167807 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/678706a8-cc82-4819-89c9-4067aa0d2dd6-multus-daemon-config\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-multus-certs\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167868 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/678706a8-cc82-4819-89c9-4067aa0d2dd6-host-run-multus-certs\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-systemd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.169545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167915 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.170385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.167921 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/46da1f68-eb61-4a3e-9362-aa423cd81ce8-run-systemd\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.170385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.169485 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/46da1f68-eb61-4a3e-9362-aa423cd81ce8-ovn-node-metrics-cert\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.170385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.169607 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f69c71f3-39de-44ba-880f-95f042bf0e23-agent-certs\") pod \"konnectivity-agent-c9s84\" (UID: \"f69c71f3-39de-44ba-880f-95f042bf0e23\") " pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.171127 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.171066 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:10:58.171127 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.171088 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:10:58.171127 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.171101 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:58.171361 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.171150 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:10:58.67113435 +0000 UTC m=+2.973916835 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:58.172990 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.172967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4khr\" (UniqueName: \"kubernetes.io/projected/88c8753c-f4bf-48cb-a4c7-e7515104b8a1-kube-api-access-w4khr\") pod \"aws-ebs-csi-driver-node-62g9g\" (UID: \"88c8753c-f4bf-48cb-a4c7-e7515104b8a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.173079 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.173025 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjtgr\" (UniqueName: \"kubernetes.io/projected/46da1f68-eb61-4a3e-9362-aa423cd81ce8-kube-api-access-qjtgr\") pod \"ovnkube-node-xl795\" (UID: \"46da1f68-eb61-4a3e-9362-aa423cd81ce8\") " pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.176115 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.176071 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnh7b\" (UniqueName: \"kubernetes.io/projected/3fdd4cf1-9bbc-4949-877f-2f14852b404f-kube-api-access-wnh7b\") pod \"node-resolver-dpbd5\" (UID: \"3fdd4cf1-9bbc-4949-877f-2f14852b404f\") " pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.176755 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.176713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4q7sl\" (UniqueName: \"kubernetes.io/projected/4dbeca93-1c17-4494-b680-0cb718fcb494-kube-api-access-4q7sl\") pod \"iptables-alerter-zj8lm\" (UID: \"4dbeca93-1c17-4494-b680-0cb718fcb494\") " pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.177995 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.177976 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp99k\" (UniqueName: \"kubernetes.io/projected/678706a8-cc82-4819-89c9-4067aa0d2dd6-kube-api-access-dp99k\") pod \"multus-zhhms\" (UID: \"678706a8-cc82-4819-89c9-4067aa0d2dd6\") " pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.178281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.178260 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m797j\" (UniqueName: \"kubernetes.io/projected/f5bf7c05-0c41-4323-9d35-d5d1e416baea-kube-api-access-m797j\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.269110 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-modprobe-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269291 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269121 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-tmp\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269291 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hds7f\" (UniqueName: \"kubernetes.io/projected/fd4d53b1-a743-4a54-be7f-7869b233ccc9-kube-api-access-hds7f\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269291 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269275 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-system-cni-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269318 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-system-cni-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269277 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-modprobe-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269324 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269379 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-lib-modules\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-host\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.269450 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4s8lw\" (UniqueName: \"kubernetes.io/projected/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-kube-api-access-4s8lw\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-systemd\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269481 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269505 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scf92\" (UniqueName: \"kubernetes.io/projected/04b7bec0-4068-4125-80f8-89c2533591fe-kube-api-access-scf92\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-lib-modules\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269567 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-kubernetes\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-sys\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-systemd\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-var-lib-kubelet\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269648 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-os-release\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269679 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-serviceca\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269692 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-host\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.269738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-var-lib-kubelet\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269753 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-run\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269773 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-os-release\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269778 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-kubernetes\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-host\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-sys\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269843 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-cnibin\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269874 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-host\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269886 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-conf\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysconfig\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.269929 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-tuned\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270111 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-binary-copy\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270255 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-d\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-run\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/04b7bec0-4068-4125-80f8-89c2533591fe-cnibin\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.270392 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270367 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysconfig\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.271103 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-sysctl-conf\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.271103 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/04b7bec0-4068-4125-80f8-89c2533591fe-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.271103 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.270740 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-serviceca\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.272429 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.272404 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-tmp\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.272550 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.272456 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fd4d53b1-a743-4a54-be7f-7869b233ccc9-etc-tuned\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.281538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.281457 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scf92\" (UniqueName: \"kubernetes.io/projected/04b7bec0-4068-4125-80f8-89c2533591fe-kube-api-access-scf92\") pod \"multus-additional-cni-plugins-pktvn\" (UID: \"04b7bec0-4068-4125-80f8-89c2533591fe\") " pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.281642 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.281562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s8lw\" (UniqueName: \"kubernetes.io/projected/a30f8f32-4b1a-4b12-9d24-dba98634a0ae-kube-api-access-4s8lw\") pod \"node-ca-sqk5n\" (UID: \"a30f8f32-4b1a-4b12-9d24-dba98634a0ae\") " pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.281925 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.281907 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hds7f\" (UniqueName: \"kubernetes.io/projected/fd4d53b1-a743-4a54-be7f-7869b233ccc9-kube-api-access-hds7f\") pod \"tuned-4rbnz\" (UID: \"fd4d53b1-a743-4a54-be7f-7869b233ccc9\") " pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.353580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.353546 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:10:58.361285 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.361263 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zhhms" Jun 05 14:10:58.370771 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.370749 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zj8lm" Jun 05 14:10:58.377505 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.377483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:10:58.384317 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.384300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" Jun 05 14:10:58.390041 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.390013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-dpbd5" Jun 05 14:10:58.397756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.397735 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" Jun 05 14:10:58.402535 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.402519 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-sqk5n" Jun 05 14:10:58.408132 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.408112 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pktvn" Jun 05 14:10:58.673048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.672967 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:10:58.673048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.673011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:58.673228 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:58.673053 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:58.673228 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673145 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:58.673228 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673155 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:10:58.673228 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673207 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:10:59.673183412 +0000 UTC m=+3.975965883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:58.673228 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673221 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:10:59.673215171 +0000 UTC m=+3.975997641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:10:58.673449 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673153 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:10:58.673449 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673261 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:10:58.673449 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673283 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:58.673449 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:58.673325 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:10:59.673309259 +0000 UTC m=+3.976091734 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:58.869880 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.869836 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46da1f68_eb61_4a3e_9362_aa423cd81ce8.slice/crio-79195280cd3e7d898739f3534f09d5f613b5edfa0a6ac23a88da1685a43c5279 WatchSource:0}: Error finding container 79195280cd3e7d898739f3534f09d5f613b5edfa0a6ac23a88da1685a43c5279: Status 404 returned error can't find the container with id 79195280cd3e7d898739f3534f09d5f613b5edfa0a6ac23a88da1685a43c5279 Jun 05 14:10:58.871063 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.871033 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c8753c_f4bf_48cb_a4c7_e7515104b8a1.slice/crio-77e31d96a8e6e403b06f20ceb913730e104b1cbc32a7a493b7d375cef41ce4c2 WatchSource:0}: Error finding container 77e31d96a8e6e403b06f20ceb913730e104b1cbc32a7a493b7d375cef41ce4c2: Status 404 returned error can't find the container with id 77e31d96a8e6e403b06f20ceb913730e104b1cbc32a7a493b7d375cef41ce4c2 Jun 05 14:10:58.872592 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.872569 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fdd4cf1_9bbc_4949_877f_2f14852b404f.slice/crio-e616175d59c0736ec010c4b7d2f1a5676cb4adc70ccb968965fa55e82a52279a WatchSource:0}: Error finding container e616175d59c0736ec010c4b7d2f1a5676cb4adc70ccb968965fa55e82a52279a: Status 404 returned error can't find the container with id e616175d59c0736ec010c4b7d2f1a5676cb4adc70ccb968965fa55e82a52279a Jun 05 14:10:58.875853 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.875828 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod678706a8_cc82_4819_89c9_4067aa0d2dd6.slice/crio-63a5d64971201515239faf55bac3bb2e9f03d372c505a1c86fbd1c90407cf1ff WatchSource:0}: Error finding container 63a5d64971201515239faf55bac3bb2e9f03d372c505a1c86fbd1c90407cf1ff: Status 404 returned error can't find the container with id 63a5d64971201515239faf55bac3bb2e9f03d372c505a1c86fbd1c90407cf1ff Jun 05 14:10:58.876472 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.876454 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf69c71f3_39de_44ba_880f_95f042bf0e23.slice/crio-752d7830ba1f0df8f498f34abd5db2cf835e5e48b9f0799f0bcb3dbd6f26c597 WatchSource:0}: Error finding container 752d7830ba1f0df8f498f34abd5db2cf835e5e48b9f0799f0bcb3dbd6f26c597: Status 404 returned error can't find the container with id 752d7830ba1f0df8f498f34abd5db2cf835e5e48b9f0799f0bcb3dbd6f26c597 Jun 05 14:10:58.877908 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.877889 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbeca93_1c17_4494_b680_0cb718fcb494.slice/crio-9d2fa24f202a9436ca13d7d9352dd7a69e8fb5fee51d73b8f61f4cd61e1164c4 WatchSource:0}: Error finding container 9d2fa24f202a9436ca13d7d9352dd7a69e8fb5fee51d73b8f61f4cd61e1164c4: Status 404 returned error can't find the container with id 9d2fa24f202a9436ca13d7d9352dd7a69e8fb5fee51d73b8f61f4cd61e1164c4 Jun 05 14:10:58.879503 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.879188 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda30f8f32_4b1a_4b12_9d24_dba98634a0ae.slice/crio-b4d678bdb658ca1c9ddeacd18ffefb7f1b4049c132086b836fc692f301b102a2 WatchSource:0}: Error finding container b4d678bdb658ca1c9ddeacd18ffefb7f1b4049c132086b836fc692f301b102a2: Status 404 returned error can't find the container with id b4d678bdb658ca1c9ddeacd18ffefb7f1b4049c132086b836fc692f301b102a2 Jun 05 14:10:58.881009 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.880897 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04b7bec0_4068_4125_80f8_89c2533591fe.slice/crio-1c548666e5307e376b1c9dd2732abb0e3591c14d85fb9c9eb29d33fd6262fff4 WatchSource:0}: Error finding container 1c548666e5307e376b1c9dd2732abb0e3591c14d85fb9c9eb29d33fd6262fff4: Status 404 returned error can't find the container with id 1c548666e5307e376b1c9dd2732abb0e3591c14d85fb9c9eb29d33fd6262fff4 Jun 05 14:10:58.881772 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:10:58.881724 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd4d53b1_a743_4a54_be7f_7869b233ccc9.slice/crio-7d1e2d352c78d27236be522826b863daca45430dc6e3303eb6d701ca6900f25c WatchSource:0}: Error finding container 7d1e2d352c78d27236be522826b863daca45430dc6e3303eb6d701ca6900f25c: Status 404 returned error can't find the container with id 7d1e2d352c78d27236be522826b863daca45430dc6e3303eb6d701ca6900f25c Jun 05 14:10:59.120998 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.120971 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:59.121355 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.121081 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:10:59.129209 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.129169 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" event={"ID":"fd4d53b1-a743-4a54-be7f-7869b233ccc9","Type":"ContainerStarted","Data":"7d1e2d352c78d27236be522826b863daca45430dc6e3303eb6d701ca6900f25c"} Jun 05 14:10:59.130189 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.130169 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zj8lm" event={"ID":"4dbeca93-1c17-4494-b680-0cb718fcb494","Type":"ContainerStarted","Data":"9d2fa24f202a9436ca13d7d9352dd7a69e8fb5fee51d73b8f61f4cd61e1164c4"} Jun 05 14:10:59.131681 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.131662 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhhms" event={"ID":"678706a8-cc82-4819-89c9-4067aa0d2dd6","Type":"ContainerStarted","Data":"63a5d64971201515239faf55bac3bb2e9f03d372c505a1c86fbd1c90407cf1ff"} Jun 05 14:10:59.132774 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.132755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpbd5" event={"ID":"3fdd4cf1-9bbc-4949-877f-2f14852b404f","Type":"ContainerStarted","Data":"e616175d59c0736ec010c4b7d2f1a5676cb4adc70ccb968965fa55e82a52279a"} Jun 05 14:10:59.133760 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.133741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" event={"ID":"88c8753c-f4bf-48cb-a4c7-e7515104b8a1","Type":"ContainerStarted","Data":"77e31d96a8e6e403b06f20ceb913730e104b1cbc32a7a493b7d375cef41ce4c2"} Jun 05 14:10:59.134773 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.134755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"79195280cd3e7d898739f3534f09d5f613b5edfa0a6ac23a88da1685a43c5279"} Jun 05 14:10:59.138669 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.138642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerStarted","Data":"1c548666e5307e376b1c9dd2732abb0e3591c14d85fb9c9eb29d33fd6262fff4"} Jun 05 14:10:59.139732 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.139709 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqk5n" event={"ID":"a30f8f32-4b1a-4b12-9d24-dba98634a0ae","Type":"ContainerStarted","Data":"b4d678bdb658ca1c9ddeacd18ffefb7f1b4049c132086b836fc692f301b102a2"} Jun 05 14:10:59.140864 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.140842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c9s84" event={"ID":"f69c71f3-39de-44ba-880f-95f042bf0e23","Type":"ContainerStarted","Data":"752d7830ba1f0df8f498f34abd5db2cf835e5e48b9f0799f0bcb3dbd6f26c597"} Jun 05 14:10:59.143534 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.143509 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" event={"ID":"b5cf065bc1451597f31ffcaf868f9a3f","Type":"ContainerStarted","Data":"d4bf3fc6e68bcf4b6765419c52d06f29cac99f394d3b07189b00ea136ae777f9"} Jun 05 14:10:59.144797 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.144762 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 14:05:58 +0000 UTC" deadline="2028-01-10 17:22:20.276732164 +0000 UTC" Jun 05 14:10:59.144859 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.144797 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14019h11m21.13193747s" Jun 05 14:10:59.160497 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.160459 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-39.ec2.internal" podStartSLOduration=2.160447073 podStartE2EDuration="2.160447073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:10:59.160068273 +0000 UTC m=+3.462850766" watchObservedRunningTime="2026-06-05 14:10:59.160447073 +0000 UTC m=+3.463229566" Jun 05 14:10:59.546829 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.546796 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 14:10:59.680557 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.680517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:10:59.680752 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.680582 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:10:59.680752 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:10:59.680628 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:10:59.680873 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.680760 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:59.680873 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.680821 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:11:01.680802816 +0000 UTC m=+5.983585290 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:10:59.681240 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681221 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:10:59.681318 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681250 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:10:59.681318 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681263 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:59.681318 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681307 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:11:01.681292773 +0000 UTC m=+5.984075244 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:10:59.681472 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681368 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:10:59.681472 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:10:59.681401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:11:01.681389902 +0000 UTC m=+5.984172377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:00.123280 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.123249 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:00.123713 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:00.123375 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:00.123786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.123750 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:00.123884 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:00.123841 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:00.145922 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.145743 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 14:05:58 +0000 UTC" deadline="2028-01-04 02:09:13.364754878 +0000 UTC" Jun 05 14:11:00.145922 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.145777 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13859h58m13.218983061s" Jun 05 14:11:00.168168 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.167985 2575 generic.go:356] "Generic (PLEG): container finished" podID="ef79c930afce4520cd954c5aeb9fd0a5" containerID="8dc21d2341805b0f14785b9398d290466451af6445e3af186dfaa29468a70885" exitCode=0 Jun 05 14:11:00.168168 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:00.168117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"ef79c930afce4520cd954c5aeb9fd0a5","Type":"ContainerDied","Data":"8dc21d2341805b0f14785b9398d290466451af6445e3af186dfaa29468a70885"} Jun 05 14:11:01.122413 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:01.121806 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:01.122413 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.121949 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:01.189439 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:01.189321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" event={"ID":"ef79c930afce4520cd954c5aeb9fd0a5","Type":"ContainerStarted","Data":"c3dc2f878e3c8b439f5bc7cffb97481016ac0003175afef553761a532113110d"} Jun 05 14:11:01.697997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:01.697958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:01.698169 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:01.698026 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:01.698169 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:01.698072 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:01.698303 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698217 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:01.698303 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698281 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:11:05.698262393 +0000 UTC m=+10.001044865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:01.698717 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698692 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:11:01.698717 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698713 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:11:01.698717 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698727 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:01.698911 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:11:05.698759338 +0000 UTC m=+10.001541826 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:01.698911 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698832 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:01.698911 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:01.698863 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:11:05.698852424 +0000 UTC m=+10.001634900 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:02.121824 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:02.121744 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:02.121983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:02.121760 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:02.121983 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:02.121918 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:02.122363 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:02.122335 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:03.121321 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:03.121209 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:03.121778 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:03.121350 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:04.121303 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:04.121270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:04.121487 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:04.121270 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:04.121920 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:04.121403 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:04.121920 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:04.121527 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:05.121245 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:05.121192 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:05.121503 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.121472 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:05.732612 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:05.732494 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:05.732612 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:05.732568 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:05.732614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732672 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732683 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732746 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:11:13.732726217 +0000 UTC m=+18.035508691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732763 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:11:13.732754394 +0000 UTC m=+18.035536865 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732775 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732796 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:11:05.732852 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732810 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:05.733264 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:05.732866 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:11:13.732851084 +0000 UTC m=+18.035633555 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:06.121386 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:06.121298 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:06.122267 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:06.122246 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:06.122650 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:06.122519 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:06.122754 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:06.122436 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:07.121397 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:07.121356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:07.121582 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:07.121508 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:08.121780 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:08.121747 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:08.122234 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:08.121790 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:08.122234 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:08.121881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:08.122234 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:08.122024 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:09.121408 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:09.121368 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:09.121569 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:09.121519 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:10.121388 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:10.121348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:10.121840 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:10.121485 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:10.121840 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:10.121536 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:10.121840 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:10.121641 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:11.121833 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:11.121799 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:11.122391 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:11.121941 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:12.121774 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:12.121736 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:12.121995 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:12.121863 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:12.121995 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:12.121929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:12.122396 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:12.122042 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:13.121139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:13.121104 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:13.121339 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.121247 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:13.791755 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:13.791720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:13.791773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:13.791818 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791911 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791921 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791950 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791963 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791976 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:11:29.79195617 +0000 UTC m=+34.094738642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.791911 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.792018 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:11:29.792001826 +0000 UTC m=+34.094784312 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:13.792177 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:13.792040 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:11:29.792027964 +0000 UTC m=+34.094810447 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:14.121758 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:14.121677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:14.121928 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:14.121677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:14.121928 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:14.121798 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:14.121928 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:14.121868 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:15.121165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:15.121130 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:15.121607 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:15.121268 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:16.121996 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:16.121892 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:16.122417 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:16.122008 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:16.122417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:16.122061 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:16.122417 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:16.122212 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:17.121678 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:17.121652 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:17.121789 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:17.121752 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:18.121163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.121000 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:18.121858 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.121059 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:18.121858 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:18.121332 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:18.121858 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:18.121458 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:18.221979 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.221916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-dpbd5" event={"ID":"3fdd4cf1-9bbc-4949-877f-2f14852b404f","Type":"ContainerStarted","Data":"93df8312c0af432a700dcd6ebe14eb4173ab75a56761cc78eb68cce307a4adf4"} Jun 05 14:11:18.223679 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.223621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" event={"ID":"88c8753c-f4bf-48cb-a4c7-e7515104b8a1","Type":"ContainerStarted","Data":"021df85120ce9c05f0cb7f722334fd98fda38b8259ea3e57431df8fb9aa65038"} Jun 05 14:11:18.227564 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.227541 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:11:18.227973 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.227951 2575 generic.go:356] "Generic (PLEG): container finished" podID="46da1f68-eb61-4a3e-9362-aa423cd81ce8" containerID="2f2b053303dcf105e6ca0fc7b2b8ff0521b4be32f05768d4a384674f52d09cba" exitCode=1 Jun 05 14:11:18.228096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.228033 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"01680341c70490e629069be813fb7c78fc0020842cb34bdf808dd890cd0ec406"} Jun 05 14:11:18.228165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.228107 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"e9a44b0e1dc70d9f73f047d09d96620e25138fc5b1e543827ce4d14c05d14ab6"} Jun 05 14:11:18.228165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.228160 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"21ce59c213621aa49826f0fdc2edd26c63c88fd5cbaf3af4652d37fd23b75330"} Jun 05 14:11:18.228294 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.228234 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerDied","Data":"2f2b053303dcf105e6ca0fc7b2b8ff0521b4be32f05768d4a384674f52d09cba"} Jun 05 14:11:18.228294 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.228289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"595daa6c521cf34569bb1a4f3578efac82f4dced9af6e148f4b9d46bb62d16ac"} Jun 05 14:11:18.229926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.229905 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="b20620d5dc413afb871f7b755dca886447e58bff75516094f7984b54883b8441" exitCode=0 Jun 05 14:11:18.230033 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.229981 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"b20620d5dc413afb871f7b755dca886447e58bff75516094f7984b54883b8441"} Jun 05 14:11:18.232073 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.232038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-sqk5n" event={"ID":"a30f8f32-4b1a-4b12-9d24-dba98634a0ae","Type":"ContainerStarted","Data":"b65796e3339adf5cda0b2f9b4613afee8b8aec3a7e62e315c53b6fe6e3a4b09f"} Jun 05 14:11:18.234100 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.234073 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c9s84" event={"ID":"f69c71f3-39de-44ba-880f-95f042bf0e23","Type":"ContainerStarted","Data":"e98217027dc760dab86ae446ce10f447c76e7539972a40b299c4c89b8db71387"} Jun 05 14:11:18.235806 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.235784 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" event={"ID":"fd4d53b1-a743-4a54-be7f-7869b233ccc9","Type":"ContainerStarted","Data":"f8feb2b31bf178c85637f96b638342ad33ce45f0b887a7762db5378ac429a584"} Jun 05 14:11:18.238100 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.237850 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zhhms" event={"ID":"678706a8-cc82-4819-89c9-4067aa0d2dd6","Type":"ContainerStarted","Data":"f08e9b190582345c0d61c1579e5aa70bd1b5db71c1cfbc305d607c3f1016a540"} Jun 05 14:11:18.239835 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.239743 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-39.ec2.internal" podStartSLOduration=21.239709293 podStartE2EDuration="21.239709293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:01.206968964 +0000 UTC m=+5.509751459" watchObservedRunningTime="2026-06-05 14:11:18.239709293 +0000 UTC m=+22.542491781" Jun 05 14:11:18.240726 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.240649 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-dpbd5" podStartSLOduration=4.007646913 podStartE2EDuration="22.240637796s" totalImagesPullingTime="18.232990883s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:18.239680841 +0000 UTC m=+22.542463334" watchObservedRunningTime="2026-06-05 14:11:18.240637796 +0000 UTC m=+22.543420289" Jun 05 14:11:18.263172 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.263110 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4rbnz" podStartSLOduration=3.683909171 podStartE2EDuration="22.263088316s" totalImagesPullingTime="18.579179145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:18.262567533 +0000 UTC m=+22.565350029" watchObservedRunningTime="2026-06-05 14:11:18.263088316 +0000 UTC m=+22.565870809" Jun 05 14:11:18.278253 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.278192 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-sqk5n" podStartSLOduration=3.6959646360000002 podStartE2EDuration="22.278173976s" totalImagesPullingTime="18.58220934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:18.277702389 +0000 UTC m=+22.580484883" watchObservedRunningTime="2026-06-05 14:11:18.278173976 +0000 UTC m=+22.580956468" Jun 05 14:11:18.340995 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:18.340945 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c9s84" podStartSLOduration=3.779915537 podStartE2EDuration="22.340929882s" totalImagesPullingTime="18.561014345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:18.340741158 +0000 UTC m=+22.643523652" watchObservedRunningTime="2026-06-05 14:11:18.340929882 +0000 UTC m=+22.643712373" Jun 05 14:11:19.061455 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.061209 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 14:11:19.118500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.118338 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T14:11:19.061448809Z","UUID":"ad1cbbbb-2268-403b-99c1-0cccfd415f22","Handler":null,"Name":"","Endpoint":""} Jun 05 14:11:19.119929 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.119902 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 14:11:19.120052 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.119947 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 14:11:19.121211 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.121173 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:19.121559 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:19.121333 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:19.242441 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.242404 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zj8lm" event={"ID":"4dbeca93-1c17-4494-b680-0cb718fcb494","Type":"ContainerStarted","Data":"71ebc90ad4acb0601eee3b48a5770155cbefb454c1a5525e7422a94847bd2b57"} Jun 05 14:11:19.244525 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.244492 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" event={"ID":"88c8753c-f4bf-48cb-a4c7-e7515104b8a1","Type":"ContainerStarted","Data":"aba98a1d6e82e6cb51b3a5bd754000e5211615c22013188a3171ada2aa26170b"} Jun 05 14:11:19.247708 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.247686 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:11:19.248181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.248155 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"5256f3fe3b1d3cd4a10d62b858784fa4c744931221412dbd9eb0c960fb58b12b"} Jun 05 14:11:19.260692 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.260651 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zhhms" podStartSLOduration=4.634426578 podStartE2EDuration="23.26063698s" totalImagesPullingTime="18.626210402s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:18.364854767 +0000 UTC m=+22.667637259" watchObservedRunningTime="2026-06-05 14:11:19.26063698 +0000 UTC m=+23.563419472" Jun 05 14:11:19.260932 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:19.260908 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zj8lm" podStartSLOduration=4.677207533 podStartE2EDuration="23.260902757s" totalImagesPullingTime="18.583695224s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:19.260438692 +0000 UTC m=+23.563221187" watchObservedRunningTime="2026-06-05 14:11:19.260902757 +0000 UTC m=+23.563685249" Jun 05 14:11:20.121690 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.121658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:20.122246 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.121658 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:20.122246 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:20.121785 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:20.122468 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:20.122224 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:20.139159 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.139127 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:11:20.139738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.139718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:11:20.252800 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.252707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" event={"ID":"88c8753c-f4bf-48cb-a4c7-e7515104b8a1","Type":"ContainerStarted","Data":"9cab7d93554e5dbede5f5c0c5c7abe93a703e7bff24570d21bc35d6a3b630d26"} Jun 05 14:11:20.252972 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.252826 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:11:20.253408 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.253377 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c9s84" Jun 05 14:11:20.271370 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:20.271324 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-62g9g" podStartSLOduration=4.024753725 podStartE2EDuration="24.271306381s" totalImagesPullingTime="20.246552656s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:20.270909084 +0000 UTC m=+24.573691577" watchObservedRunningTime="2026-06-05 14:11:20.271306381 +0000 UTC m=+24.574088872" Jun 05 14:11:21.121055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:21.121021 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:21.121234 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:21.121168 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:21.257918 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:21.257887 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:11:21.258538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:21.258333 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"4f8972070b622aa2b098462cbe56e3ea076914556569c50533460d12175b4455"} Jun 05 14:11:22.120863 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:22.120824 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:22.121067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:22.120824 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:22.121067 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:22.120963 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:22.121067 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:22.121054 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:23.121407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.121245 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:23.121865 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:23.121486 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:23.265912 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.265878 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:11:23.269248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.266567 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"cb7e7d69aeb908711384a8ee966134184eb165e35f1393b49c55d069018cd9ab"} Jun 05 14:11:23.269248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.267584 2575 scope.go:117] "RemoveContainer" containerID="2f2b053303dcf105e6ca0fc7b2b8ff0521b4be32f05768d4a384674f52d09cba" Jun 05 14:11:23.269248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.268439 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:23.269248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.268744 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:23.269248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.268846 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:23.271507 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.271474 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="80f670cafdc9fb2a67bffcf6d9f3eff647f8de47f36e4c43fdf71810de81ab49" exitCode=0 Jun 05 14:11:23.271619 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.271511 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"80f670cafdc9fb2a67bffcf6d9f3eff647f8de47f36e4c43fdf71810de81ab49"} Jun 05 14:11:23.285048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.285027 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:23.285366 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:23.285349 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:24.120959 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.120929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:24.121146 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.120930 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:24.121146 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:24.121040 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:24.121281 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:24.121161 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:24.275680 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.275600 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="e83b48cc198b319db662a1015befaaa4dcca4e47f1326b9c8b7236008872fc4a" exitCode=0 Jun 05 14:11:24.276082 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.275678 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"e83b48cc198b319db662a1015befaaa4dcca4e47f1326b9c8b7236008872fc4a"} Jun 05 14:11:24.279494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.279478 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:11:24.279853 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.279829 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" event={"ID":"46da1f68-eb61-4a3e-9362-aa423cd81ce8","Type":"ContainerStarted","Data":"d3bbdb241ac4c439e651ca503a65ce767fb5d57d4b298cac6e3cc0f52269371a"} Jun 05 14:11:24.328593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.328544 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" podStartSLOduration=9.654605283 podStartE2EDuration="28.328529394s" totalImagesPullingTime="18.673924111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:24.327958273 +0000 UTC m=+28.630740766" watchObservedRunningTime="2026-06-05 14:11:24.328529394 +0000 UTC m=+28.631311887" Jun 05 14:11:24.419558 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.419530 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9p67f"] Jun 05 14:11:24.419699 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.419662 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:24.419797 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:24.419774 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:24.422708 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.422681 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsrrq"] Jun 05 14:11:24.422825 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.422792 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:24.422908 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:24.422889 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:24.423316 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.423292 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2flc8"] Jun 05 14:11:24.423426 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:24.423392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:24.423508 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:24.423490 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:25.284041 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:25.283774 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="18bdbb8448a86d9a890eb2c9d579a95b6b5e01cc557ff66dfac317b4437b0a3f" exitCode=0 Jun 05 14:11:25.284041 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:25.283836 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"18bdbb8448a86d9a890eb2c9d579a95b6b5e01cc557ff66dfac317b4437b0a3f"} Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:26.123041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:26.123233 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:26.123371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:26.123371 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:26.123418 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:26.125658 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:26.123501 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:28.121602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:28.121558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:28.121602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:28.121588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:28.122328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:28.121588 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:28.122328 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:28.121715 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:28.122328 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:28.121801 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:28.122328 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:28.121940 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:29.818786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:29.818756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:29.818802 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:29.818828 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818913 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818926 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818926 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818941 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818953 2575 projected.go:196] Error preparing data for projected volume kube-api-access-5c7bv for pod openshift-network-diagnostics/network-check-target-9p67f: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818978 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret podName:ccbf197b-a176-4924-9ae5-35874a6c456a nodeName:}" failed. No retries permitted until 2026-06-05 14:12:01.818962913 +0000 UTC m=+66.121745388 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret") pod "global-pull-secret-syncer-jsrrq" (UID: "ccbf197b-a176-4924-9ae5-35874a6c456a") : object "kube-system"/"original-pull-secret" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.818993 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:12:01.81898582 +0000 UTC m=+66.121768290 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 14:11:29.819138 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:29.819002 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv podName:b637097c-30a6-4f76-909a-eeaf1d173d9c nodeName:}" failed. No retries permitted until 2026-06-05 14:12:01.818996927 +0000 UTC m=+66.121779398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5c7bv" (UniqueName: "kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv") pod "network-check-target-9p67f" (UID: "b637097c-30a6-4f76-909a-eeaf1d173d9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 14:11:30.121531 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.121352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:30.121769 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.121364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:30.121769 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.121610 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:11:30.121769 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.121364 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:30.121769 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.121692 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9p67f" podUID="b637097c-30a6-4f76-909a-eeaf1d173d9c" Jun 05 14:11:30.121769 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.121760 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jsrrq" podUID="ccbf197b-a176-4924-9ae5-35874a6c456a" Jun 05 14:11:30.298913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.298882 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="6fe64bb535c664683cab5d4a505e274c947c1221d47e5ce84878e593dd1d6147" exitCode=0 Jun 05 14:11:30.299098 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.298948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"6fe64bb535c664683cab5d4a505e274c947c1221d47e5ce84878e593dd1d6147"} Jun 05 14:11:30.570257 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.570229 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-39.ec2.internal" event="NodeReady" Jun 05 14:11:30.570445 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.570356 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 14:11:30.606148 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.606116 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:11:30.624269 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.624228 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:11:30.624447 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.624303 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.624447 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.624367 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-966l6"] Jun 05 14:11:30.627578 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.627420 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 14:11:30.627782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.627760 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 14:11:30.627860 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.627789 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6w5w\"" Jun 05 14:11:30.628087 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.628068 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 14:11:30.634067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.634046 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 14:11:30.646466 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.646442 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rb546"] Jun 05 14:11:30.646594 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.646576 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.649432 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.649406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksmwl\"" Jun 05 14:11:30.649563 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.649459 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 14:11:30.649563 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.649465 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 14:11:30.664321 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.664297 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rb546"] Jun 05 14:11:30.664321 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.664324 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-966l6"] Jun 05 14:11:30.664458 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.664404 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.667188 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.667171 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 14:11:30.667272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.667245 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 14:11:30.667272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.667264 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-rp2sg\"" Jun 05 14:11:30.667375 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.667264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 14:11:30.724141 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724167 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tct5t\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsqt6\" (UniqueName: \"kubernetes.io/projected/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-kube-api-access-zsqt6\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.724381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724240 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-config-volume\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.724381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.724381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724296 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724390 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724422 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724482 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.724565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.724519 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-tmp-dir\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.825440 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825399 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825457 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825527 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825558 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825592 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq474\" (UniqueName: \"kubernetes.io/projected/76018a2b-b732-4ab4-a180-601527a27ef4-kube-api-access-kq474\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825621 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.825626 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.825649 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.825719 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:11:31.325699549 +0000 UTC m=+35.628482021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825646 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76018a2b-b732-4ab4-a180-601527a27ef4-cert\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825805 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-tmp-dir\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tct5t\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.825908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsqt6\" (UniqueName: \"kubernetes.io/projected/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-kube-api-access-zsqt6\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-config-volume\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.825951 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.826120 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-tmp-dir\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.826249 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:30.826300 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:11:31.326282654 +0000 UTC m=+35.629065124 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.826365 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.826674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.826555 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-config-volume\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.827027 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.826862 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.827027 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.826944 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.829539 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.829517 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.829539 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.829527 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.834632 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.834598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsqt6\" (UniqueName: \"kubernetes.io/projected/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-kube-api-access-zsqt6\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:30.834761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.834684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tct5t\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.834761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.834710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:30.926651 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.926561 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq474\" (UniqueName: \"kubernetes.io/projected/76018a2b-b732-4ab4-a180-601527a27ef4-kube-api-access-kq474\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.926651 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.926601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76018a2b-b732-4ab4-a180-601527a27ef4-cert\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.929002 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.928974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/76018a2b-b732-4ab4-a180-601527a27ef4-cert\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.934984 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.934962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq474\" (UniqueName: \"kubernetes.io/projected/76018a2b-b732-4ab4-a180-601527a27ef4-kube-api-access-kq474\") pod \"ingress-canary-rb546\" (UID: \"76018a2b-b732-4ab4-a180-601527a27ef4\") " pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:30.972110 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:30.972073 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rb546" Jun 05 14:11:31.145591 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.145558 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rb546"] Jun 05 14:11:31.148978 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:11:31.148948 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76018a2b_b732_4ab4_a180_601527a27ef4.slice/crio-36671d330cc64f7b68ab7361e614140ac31078dcd0924db56fd5a07123d43576 WatchSource:0}: Error finding container 36671d330cc64f7b68ab7361e614140ac31078dcd0924db56fd5a07123d43576: Status 404 returned error can't find the container with id 36671d330cc64f7b68ab7361e614140ac31078dcd0924db56fd5a07123d43576 Jun 05 14:11:31.304298 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.304193 2575 generic.go:356] "Generic (PLEG): container finished" podID="04b7bec0-4068-4125-80f8-89c2533591fe" containerID="7a3001ac4bad40a587184fc25f3fac30b6bf84ddb563b89957a130dd1bff41d1" exitCode=0 Jun 05 14:11:31.304298 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.304224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerDied","Data":"7a3001ac4bad40a587184fc25f3fac30b6bf84ddb563b89957a130dd1bff41d1"} Jun 05 14:11:31.305416 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.305394 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rb546" event={"ID":"76018a2b-b732-4ab4-a180-601527a27ef4","Type":"ContainerStarted","Data":"36671d330cc64f7b68ab7361e614140ac31078dcd0924db56fd5a07123d43576"} Jun 05 14:11:31.329369 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.329337 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:31.329503 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.329393 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:31.329503 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:31.329478 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:31.329503 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:31.329497 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:31.329638 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:31.329511 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:31.329638 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:31.329532 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:11:32.329517498 +0000 UTC m=+36.632299968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:31.329638 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:31.329557 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:11:32.329540752 +0000 UTC m=+36.632323238 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:31.870819 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.870633 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:31.951928 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:31.951892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:32.013427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.013394 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:32.121489 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.121402 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:11:32.121724 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.121413 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:11:32.121724 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.121413 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125830 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125849 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125855 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8nn7\"" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125849 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125913 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 14:11:32.125968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.125849 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2hcm\"" Jun 05 14:11:32.311391 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.311355 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pktvn" event={"ID":"04b7bec0-4068-4125-80f8-89c2533591fe","Type":"ContainerStarted","Data":"858a134dcd86cbc52b9fbbf0870ecfe31f19794f8276b0199ea4cd2ad6a8cd3e"} Jun 05 14:11:32.334619 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.334561 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pktvn" podStartSLOduration=7.766527402 podStartE2EDuration="36.334539162s" totalImagesPullingTime="28.56801176s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:32.332859263 +0000 UTC m=+36.635641757" watchObservedRunningTime="2026-06-05 14:11:32.334539162 +0000 UTC m=+36.637321654" Jun 05 14:11:32.337216 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.337176 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:32.337343 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.337250 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:32.337343 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:32.337323 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:32.337343 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:32.337336 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:32.337500 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:32.337346 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:32.337500 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:32.337386 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:11:34.337367684 +0000 UTC m=+38.640150172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:32.337500 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:32.337401 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:11:34.33739458 +0000 UTC m=+38.640177051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:32.453886 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.453796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:32.534516 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:32.534480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:34.319738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:34.319706 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rb546" event={"ID":"76018a2b-b732-4ab4-a180-601527a27ef4","Type":"ContainerStarted","Data":"9c593a6be6c00b3e70874f01178d5ae6e82a4ef1476403b9bd526cb386ffec34"} Jun 05 14:11:34.337777 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:34.337734 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rb546" podStartSLOduration=1.44814779 podStartE2EDuration="4.337720213s" totalImagesPullingTime="2.889572423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:11:34.335880003 +0000 UTC m=+38.638662493" watchObservedRunningTime="2026-06-05 14:11:34.337720213 +0000 UTC m=+38.640502719" Jun 05 14:11:34.353411 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:34.353375 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:34.353544 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:34.353432 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:34.353544 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:34.353525 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:34.353544 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:34.353536 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:34.353646 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:34.353584 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:11:38.353572184 +0000 UTC m=+42.656354679 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:34.353693 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:34.353639 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:34.353725 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:34.353705 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:11:38.353687533 +0000 UTC m=+42.656470019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:35.434750 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:35.434715 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:35.500668 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:35.500629 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:35.812870 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:35.812787 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:35.869068 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:35.869025 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:36.917408 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:36.917377 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:37.017307 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:37.017272 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:38.384695 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:38.384643 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:38.385162 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:38.384760 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:38.385162 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:38.384957 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:38.385162 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:38.384972 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:38.385162 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:38.385047 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:11:46.385030306 +0000 UTC m=+50.687812777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:38.385633 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:38.385611 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:38.385692 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:38.385677 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:11:46.385660734 +0000 UTC m=+50.688443217 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:45.077613 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:45.077581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:45.178375 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:45.178338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:46.434912 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:46.434873 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:46.434930 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:46.435028 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:46.435103 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:12:02.43508661 +0000 UTC m=+66.737869080 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:46.435032 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:46.435131 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:11:46.435313 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:11:46.435171 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:12:02.435159114 +0000 UTC m=+66.737941584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:11:46.968139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:46.968100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:47.068166 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:47.068126 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:55.294832 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:55.294806 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xl795" Jun 05 14:11:55.444439 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:55.444405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:11:55.544479 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:11:55.544446 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:00.421886 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:00.421844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:00.478717 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:00.478679 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:01.845936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.845894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:12:01.846456 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.845949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:12:01.846456 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.845985 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:12:01.848883 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.848866 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 14:12:01.848952 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.848893 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 14:12:01.848986 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.848973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 14:12:01.856254 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:01.856232 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 14:12:01.856315 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:01.856303 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:13:05.856281169 +0000 UTC m=+130.159063640 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : secret "metrics-daemon-secret" not found Jun 05 14:12:01.858571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.858558 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 14:12:01.859444 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.859426 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ccbf197b-a176-4924-9ae5-35874a6c456a-original-pull-secret\") pod \"global-pull-secret-syncer-jsrrq\" (UID: \"ccbf197b-a176-4924-9ae5-35874a6c456a\") " pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:12:01.868649 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:01.868629 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5c7bv\" (UniqueName: \"kubernetes.io/projected/b637097c-30a6-4f76-909a-eeaf1d173d9c-kube-api-access-5c7bv\") pod \"network-check-target-9p67f\" (UID: \"b637097c-30a6-4f76-909a-eeaf1d173d9c\") " pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:12:02.131953 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.131872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jsrrq" Jun 05 14:12:02.141014 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.140987 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-z8nn7\"" Jun 05 14:12:02.148238 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.148219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:12:02.319123 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.319092 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jsrrq"] Jun 05 14:12:02.323167 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:12:02.323137 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccbf197b_a176_4924_9ae5_35874a6c456a.slice/crio-0e9a20149b7462ba25cc39d5bb82849abd1cce0be3cf91df769733c35716e104 WatchSource:0}: Error finding container 0e9a20149b7462ba25cc39d5bb82849abd1cce0be3cf91df769733c35716e104: Status 404 returned error can't find the container with id 0e9a20149b7462ba25cc39d5bb82849abd1cce0be3cf91df769733c35716e104 Jun 05 14:12:02.344407 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.344380 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9p67f"] Jun 05 14:12:02.347471 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:12:02.347446 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb637097c_30a6_4f76_909a_eeaf1d173d9c.slice/crio-c91b8d7c56b2ac92965c9bce05eaa28f6861933020742602b4157b6a874db01f WatchSource:0}: Error finding container c91b8d7c56b2ac92965c9bce05eaa28f6861933020742602b4157b6a874db01f: Status 404 returned error can't find the container with id c91b8d7c56b2ac92965c9bce05eaa28f6861933020742602b4157b6a874db01f Jun 05 14:12:02.387032 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.386956 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9p67f" event={"ID":"b637097c-30a6-4f76-909a-eeaf1d173d9c","Type":"ContainerStarted","Data":"c91b8d7c56b2ac92965c9bce05eaa28f6861933020742602b4157b6a874db01f"} Jun 05 14:12:02.388019 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.387998 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsrrq" event={"ID":"ccbf197b-a176-4924-9ae5-35874a6c456a","Type":"ContainerStarted","Data":"0e9a20149b7462ba25cc39d5bb82849abd1cce0be3cf91df769733c35716e104"} Jun 05 14:12:02.450183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.450150 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:12:02.450349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:02.450246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:12:02.450349 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:02.450287 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:12:02.450349 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:02.450306 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:12:02.450349 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:02.450335 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:12:02.450498 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:02.450358 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:12:34.450342297 +0000 UTC m=+98.753124782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:12:02.450498 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:02.450376 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:12:34.450364809 +0000 UTC m=+98.753147280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:12:07.064655 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:07.064612 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:07.166502 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:07.166431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:08.406516 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:08.406473 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9p67f" event={"ID":"b637097c-30a6-4f76-909a-eeaf1d173d9c","Type":"ContainerStarted","Data":"1953539ab8ad83f8409e9c04fdf2ad812e29732ff53ed680a7ffa427b089492f"} Jun 05 14:12:08.406938 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:08.406595 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:12:08.407953 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:08.407929 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jsrrq" event={"ID":"ccbf197b-a176-4924-9ae5-35874a6c456a","Type":"ContainerStarted","Data":"25c5c9e027f2d1665ff1682e937987c45bb27d0c3e20b7ac1ef3e0ba38402e59"} Jun 05 14:12:08.422032 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:08.421979 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9p67f" podStartSLOduration=67.358995138 podStartE2EDuration="1m12.421962772s" totalImagesPullingTime="5.062967634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:12:08.421601403 +0000 UTC m=+72.724383898" watchObservedRunningTime="2026-06-05 14:12:08.421962772 +0000 UTC m=+72.724745242" Jun 05 14:12:08.435520 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:08.435471 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jsrrq" podStartSLOduration=67.3448697 podStartE2EDuration="1m12.435455476s" totalImagesPullingTime="5.090585776s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:12:08.43542539 +0000 UTC m=+72.738207877" watchObservedRunningTime="2026-06-05 14:12:08.435455476 +0000 UTC m=+72.738237966" Jun 05 14:12:10.780085 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:10.779971 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:10.840207 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:10.840176 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:12:34.477756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:34.477720 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:34.477776 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:34.477879 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:34.477905 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:34.477922 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:34.477954 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:13:38.477938289 +0000 UTC m=+162.780720760 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:12:34.478290 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:12:34.477981 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:13:38.47796489 +0000 UTC m=+162.780747380 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:12:39.412468 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:12:39.412432 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9p67f" Jun 05 14:13:05.896349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:05.896306 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:13:05.896832 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:05.896462 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 14:13:05.896832 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:05.896543 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:15:07.896526527 +0000 UTC m=+252.199308998 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : secret "metrics-daemon-secret" not found Jun 05 14:13:33.636793 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:33.636744 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" podUID="074af4a4-705c-4771-a709-a4042e91335d" Jun 05 14:13:33.656045 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:33.656011 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-966l6" podUID="3acd96f0-ac8e-4314-87b0-92323f4d8d7f" Jun 05 14:13:34.606083 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:34.606049 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-966l6" Jun 05 14:13:34.606297 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:34.606049 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:13:35.142135 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:35.142097 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:13:38.515602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:38.515537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:13:38.515602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:38.515609 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:13:38.516191 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:38.515701 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 05 14:13:38.516191 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:38.515770 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls podName:3acd96f0-ac8e-4314-87b0-92323f4d8d7f nodeName:}" failed. No retries permitted until 2026-06-05 14:15:40.515752991 +0000 UTC m=+284.818535462 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls") pod "dns-default-966l6" (UID: "3acd96f0-ac8e-4314-87b0-92323f4d8d7f") : secret "dns-default-metrics-tls" not found Jun 05 14:13:38.516191 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:38.515709 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 05 14:13:38.516191 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:38.515814 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8ffbcf74b-786dg: secret "image-registry-tls" not found Jun 05 14:13:38.516191 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:13:38.515874 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls podName:074af4a4-705c-4771-a709-a4042e91335d nodeName:}" failed. No retries permitted until 2026-06-05 14:15:40.515860668 +0000 UTC m=+284.818643138 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls") pod "image-registry-8ffbcf74b-786dg" (UID: "074af4a4-705c-4771-a709-a4042e91335d") : secret "image-registry-tls" not found Jun 05 14:13:50.121137 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:50.121054 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:13:54.433956 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:13:54.433919 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:14:43.835834 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:14:43.835794 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:07.941283 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:07.941231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:15:07.941756 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:07.941356 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 05 14:15:07.941756 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:07.941418 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs podName:f5bf7c05-0c41-4323-9d35-d5d1e416baea nodeName:}" failed. No retries permitted until 2026-06-05 14:17:09.941404226 +0000 UTC m=+374.244186701 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs") pod "network-metrics-daemon-2flc8" (UID: "f5bf7c05-0c41-4323-9d35-d5d1e416baea") : secret "metrics-daemon-secret" not found Jun 05 14:15:27.343730 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.343694 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67"] Jun 05 14:15:27.346484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.346465 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" Jun 05 14:15:27.349349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.349325 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-s4w9r\"" Jun 05 14:15:27.350476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.350454 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9"] Jun 05 14:15:27.353350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.353053 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww"] Jun 05 14:15:27.353350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.353150 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" Jun 05 14:15:27.355923 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.355903 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-cdc78777f-kkqpt"] Jun 05 14:15:27.356012 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.355998 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.356303 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.356279 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.356422 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.356398 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2w56c\"" Jun 05 14:15:27.356422 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.356413 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.358262 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.358245 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.358462 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.358443 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.358702 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.358668 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.359037 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.359021 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-hb55n\"" Jun 05 14:15:27.359172 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.359154 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 05 14:15:27.360917 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.360899 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 05 14:15:27.361033 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361012 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 05 14:15:27.361116 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361080 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.361160 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tbt27\"" Jun 05 14:15:27.361318 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361306 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.361515 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361501 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 05 14:15:27.361569 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.361557 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 05 14:15:27.373140 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.373119 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9"] Jun 05 14:15:27.376563 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls2z6\" (UniqueName: \"kubernetes.io/projected/bcca4fde-001e-4fbb-a070-57978e55379e-kube-api-access-ls2z6\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.376684 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376578 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtcmj\" (UniqueName: \"kubernetes.io/projected/947e4e11-4925-4d81-9ca8-22466e1901fe-kube-api-access-mtcmj\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.376684 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376638 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.376684 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376662 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmnhd\" (UniqueName: \"kubernetes.io/projected/8a8c047c-b4ce-431a-80d5-a564504e6d06-kube-api-access-zmnhd\") pod \"network-check-source-dbd9cf844-p8q67\" (UID: \"8a8c047c-b4ce-431a-80d5-a564504e6d06\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" Jun 05 14:15:27.376856 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376689 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-stats-auth\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.376856 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376721 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.376856 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376768 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf856\" (UniqueName: \"kubernetes.io/projected/a5207cd3-3728-46ba-8513-d4c9cad0a269-kube-api-access-tf856\") pod \"volume-data-source-validator-78dd696465-5z4h9\" (UID: \"a5207cd3-3728-46ba-8513-d4c9cad0a269\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" Jun 05 14:15:27.376856 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376793 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.377054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.376884 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-default-certificate\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.377054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.377017 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cdc78777f-kkqpt"] Jun 05 14:15:27.377646 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.377629 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww"] Jun 05 14:15:27.398058 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.398032 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67"] Jun 05 14:15:27.437896 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.437865 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp"] Jun 05 14:15:27.441033 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.441007 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.441725 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.441704 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd"] Jun 05 14:15:27.443674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.443657 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 05 14:15:27.443772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.443691 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.443845 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.443811 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.443900 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.443840 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xhwcb\"" Jun 05 14:15:27.444307 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.444292 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst"] Jun 05 14:15:27.444424 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.444410 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.445549 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.445534 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 05 14:15:27.446818 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.446802 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.446910 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.446893 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.447421 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.447396 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-g8jqn\"" Jun 05 14:15:27.447518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.447434 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 05 14:15:27.447518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.447450 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.447518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.447435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 05 14:15:27.449454 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.449437 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.449736 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.449721 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-k7cs9\"" Jun 05 14:15:27.449812 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.449798 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.449887 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.449870 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 05 14:15:27.450281 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.450265 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 05 14:15:27.453035 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.453013 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp"] Jun 05 14:15:27.457419 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.457394 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst"] Jun 05 14:15:27.458652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.458628 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd"] Jun 05 14:15:27.477433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477391 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls2z6\" (UniqueName: \"kubernetes.io/projected/bcca4fde-001e-4fbb-a070-57978e55379e-kube-api-access-ls2z6\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.477433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477438 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca78d1d5-ddb9-445e-9f37-be8a73a03577-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.477614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477471 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k42tg\" (UniqueName: \"kubernetes.io/projected/64e81c03-b8c9-4aea-af2c-c2fc87e78600-kube-api-access-k42tg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.477614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477488 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.477614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477504 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltq8k\" (UniqueName: \"kubernetes.io/projected/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-kube-api-access-ltq8k\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.477614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477522 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.477614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477538 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e81c03-b8c9-4aea-af2c-c2fc87e78600-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.477782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477625 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-default-certificate\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.477782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477642 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtcmj\" (UniqueName: \"kubernetes.io/projected/947e4e11-4925-4d81-9ca8-22466e1901fe-kube-api-access-mtcmj\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.477782 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.477688 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:27.97766785 +0000 UTC m=+272.280450322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : configmap references non-existent config key: service-ca.crt Jun 05 14:15:27.477782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477726 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-config\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.477782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477763 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmnhd\" (UniqueName: \"kubernetes.io/projected/8a8c047c-b4ce-431a-80d5-a564504e6d06-kube-api-access-zmnhd\") pod \"network-check-source-dbd9cf844-p8q67\" (UID: \"8a8c047c-b4ce-431a-80d5-a564504e6d06\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477815 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9f2s\" (UniqueName: \"kubernetes.io/projected/ca78d1d5-ddb9-445e-9f37-be8a73a03577-kube-api-access-c9f2s\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477843 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e81c03-b8c9-4aea-af2c-c2fc87e78600-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477872 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-stats-auth\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.477902 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477897 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.477958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477946 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf856\" (UniqueName: \"kubernetes.io/projected/a5207cd3-3728-46ba-8513-d4c9cad0a269-kube-api-access-tf856\") pod \"volume-data-source-validator-78dd696465-5z4h9\" (UID: \"a5207cd3-3728-46ba-8513-d4c9cad0a269\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" Jun 05 14:15:27.478209 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.477962 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:27.977947159 +0000 UTC m=+272.280729640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : secret "router-metrics-certs-default" not found Jun 05 14:15:27.478209 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.477991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.478209 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.478092 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 14:15:27.478209 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.478130 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls podName:947e4e11-4925-4d81-9ca8-22466e1901fe nodeName:}" failed. No retries permitted until 2026-06-05 14:15:27.978117174 +0000 UTC m=+272.280899646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mcgww" (UID: "947e4e11-4925-4d81-9ca8-22466e1901fe") : secret "samples-operator-tls" not found Jun 05 14:15:27.480326 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.480303 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-default-certificate\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.480436 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.480310 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-stats-auth\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.489995 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.489956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmnhd\" (UniqueName: \"kubernetes.io/projected/8a8c047c-b4ce-431a-80d5-a564504e6d06-kube-api-access-zmnhd\") pod \"network-check-source-dbd9cf844-p8q67\" (UID: \"8a8c047c-b4ce-431a-80d5-a564504e6d06\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" Jun 05 14:15:27.492344 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.492316 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls2z6\" (UniqueName: \"kubernetes.io/projected/bcca4fde-001e-4fbb-a070-57978e55379e-kube-api-access-ls2z6\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.492696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.492678 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtcmj\" (UniqueName: \"kubernetes.io/projected/947e4e11-4925-4d81-9ca8-22466e1901fe-kube-api-access-mtcmj\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.492738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.492720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf856\" (UniqueName: \"kubernetes.io/projected/a5207cd3-3728-46ba-8513-d4c9cad0a269-kube-api-access-tf856\") pod \"volume-data-source-validator-78dd696465-5z4h9\" (UID: \"a5207cd3-3728-46ba-8513-d4c9cad0a269\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" Jun 05 14:15:27.537547 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.537514 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hgbfn"] Jun 05 14:15:27.541436 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.541420 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.544309 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.544285 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:15:27.544447 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.544287 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 05 14:15:27.544519 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.544500 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 05 14:15:27.544574 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.544542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-lf8j5\"" Jun 05 14:15:27.544674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.544657 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 05 14:15:27.549627 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.549607 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 05 14:15:27.550763 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.550740 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hgbfn"] Jun 05 14:15:27.578764 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9f2s\" (UniqueName: \"kubernetes.io/projected/ca78d1d5-ddb9-445e-9f37-be8a73a03577-kube-api-access-c9f2s\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.578764 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578761 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e81c03-b8c9-4aea-af2c-c2fc87e78600-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578788 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-trusted-ca\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578806 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578891 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6417806e-53c9-4c3b-b377-675ab5b7363e-serving-cert\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.578895 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.578934 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8q4m\" (UniqueName: \"kubernetes.io/projected/6417806e-53c9-4c3b-b377-675ab5b7363e-kube-api-access-t8q4m\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.578978 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.578960 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:28.078941003 +0000 UTC m=+272.381723493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579036 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca78d1d5-ddb9-445e-9f37-be8a73a03577-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k42tg\" (UniqueName: \"kubernetes.io/projected/64e81c03-b8c9-4aea-af2c-c2fc87e78600-kube-api-access-k42tg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579120 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltq8k\" (UniqueName: \"kubernetes.io/projected/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-kube-api-access-ltq8k\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e81c03-b8c9-4aea-af2c-c2fc87e78600-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579165 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-config\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.579277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579244 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-config\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.579780 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579754 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/64e81c03-b8c9-4aea-af2c-c2fc87e78600-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.579923 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579840 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-config\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.579923 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.579847 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ca78d1d5-ddb9-445e-9f37-be8a73a03577-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.581113 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.581087 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/64e81c03-b8c9-4aea-af2c-c2fc87e78600-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.581300 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.581285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.591157 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.591125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9f2s\" (UniqueName: \"kubernetes.io/projected/ca78d1d5-ddb9-445e-9f37-be8a73a03577-kube-api-access-c9f2s\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:27.591426 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.591401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltq8k\" (UniqueName: \"kubernetes.io/projected/e6a208ec-0ac8-477b-87c6-f9522bab9d7e-kube-api-access-ltq8k\") pod \"service-ca-operator-6bc5ff68f5-hfbst\" (UID: \"e6a208ec-0ac8-477b-87c6-f9522bab9d7e\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.591510 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.591489 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k42tg\" (UniqueName: \"kubernetes.io/projected/64e81c03-b8c9-4aea-af2c-c2fc87e78600-kube-api-access-k42tg\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-8t4hd\" (UID: \"64e81c03-b8c9-4aea-af2c-c2fc87e78600\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.592873 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.592852 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:27.655411 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.655348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" Jun 05 14:15:27.663340 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.663324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" Jun 05 14:15:27.680598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.680573 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8q4m\" (UniqueName: \"kubernetes.io/projected/6417806e-53c9-4c3b-b377-675ab5b7363e-kube-api-access-t8q4m\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.680713 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.680660 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-config\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.680776 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.680758 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-trusted-ca\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.680844 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.680829 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6417806e-53c9-4c3b-b377-675ab5b7363e-serving-cert\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.681371 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.681351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-config\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.681884 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.681849 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6417806e-53c9-4c3b-b377-675ab5b7363e-trusted-ca\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.683034 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.683016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6417806e-53c9-4c3b-b377-675ab5b7363e-serving-cert\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.689105 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.689080 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8q4m\" (UniqueName: \"kubernetes.io/projected/6417806e-53c9-4c3b-b377-675ab5b7363e-kube-api-access-t8q4m\") pod \"console-operator-668fdbf85c-hgbfn\" (UID: \"6417806e-53c9-4c3b-b377-675ab5b7363e\") " pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.695408 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.695370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:27.758900 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.758868 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" Jun 05 14:15:27.764004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.763975 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" Jun 05 14:15:27.785234 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.785098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67"] Jun 05 14:15:27.788031 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:27.787998 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a8c047c_b4ce_431a_80d5_a564504e6d06.slice/crio-14b3ca42469579c4998b4f631dfd03f6b9e5d570c19a1edaed955a319ae2664f WatchSource:0}: Error finding container 14b3ca42469579c4998b4f631dfd03f6b9e5d570c19a1edaed955a319ae2664f: Status 404 returned error can't find the container with id 14b3ca42469579c4998b4f631dfd03f6b9e5d570c19a1edaed955a319ae2664f Jun 05 14:15:27.800733 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.800674 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9"] Jun 05 14:15:27.804227 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:27.804182 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5207cd3_3728_46ba_8513_d4c9cad0a269.slice/crio-8ebb6ced446c63179aacf614751d9b84e868a3217838887b86ac57db77b07379 WatchSource:0}: Error finding container 8ebb6ced446c63179aacf614751d9b84e868a3217838887b86ac57db77b07379: Status 404 returned error can't find the container with id 8ebb6ced446c63179aacf614751d9b84e868a3217838887b86ac57db77b07379 Jun 05 14:15:27.851848 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.851751 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:27.861578 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.861303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" event={"ID":"a5207cd3-3728-46ba-8513-d4c9cad0a269","Type":"ContainerStarted","Data":"8ebb6ced446c63179aacf614751d9b84e868a3217838887b86ac57db77b07379"} Jun 05 14:15:27.867071 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.866030 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" event={"ID":"8a8c047c-b4ce-431a-80d5-a564504e6d06","Type":"ContainerStarted","Data":"f5c2f896e82dad412d083f3bbdfa2dc4690d798278e91cce7a87535c1d52397e"} Jun 05 14:15:27.867071 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.866108 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" event={"ID":"8a8c047c-b4ce-431a-80d5-a564504e6d06","Type":"ContainerStarted","Data":"14b3ca42469579c4998b4f631dfd03f6b9e5d570c19a1edaed955a319ae2664f"} Jun 05 14:15:27.896001 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.895938 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-p8q67" podStartSLOduration=0.895914178 podStartE2EDuration="895.914178ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:27.89492297 +0000 UTC m=+272.197705464" watchObservedRunningTime="2026-06-05 14:15:27.895914178 +0000 UTC m=+272.198696672" Jun 05 14:15:27.910144 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.910024 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst"] Jun 05 14:15:27.928702 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.928636 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd"] Jun 05 14:15:27.931874 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:27.931842 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64e81c03_b8c9_4aea_af2c_c2fc87e78600.slice/crio-b370a77fe8c6f4759590f57761b9498470971eadeedc61cde0f1968b7935c6c2 WatchSource:0}: Error finding container b370a77fe8c6f4759590f57761b9498470971eadeedc61cde0f1968b7935c6c2: Status 404 returned error can't find the container with id b370a77fe8c6f4759590f57761b9498470971eadeedc61cde0f1968b7935c6c2 Jun 05 14:15:27.984001 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.983970 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.984139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.984029 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:27.984139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.984062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:27.984257 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.984136 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:28.984116704 +0000 UTC m=+273.286899178 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : configmap references non-existent config key: service-ca.crt Jun 05 14:15:27.984257 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.984157 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 14:15:27.984257 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.984210 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls podName:947e4e11-4925-4d81-9ca8-22466e1901fe nodeName:}" failed. No retries permitted until 2026-06-05 14:15:28.984185008 +0000 UTC m=+273.286967479 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mcgww" (UID: "947e4e11-4925-4d81-9ca8-22466e1901fe") : secret "samples-operator-tls" not found Jun 05 14:15:27.984257 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.984214 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 14:15:27.984391 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:27.984265 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:28.984249522 +0000 UTC m=+273.287031997 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : secret "router-metrics-certs-default" not found Jun 05 14:15:27.988513 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:27.988485 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-hgbfn"] Jun 05 14:15:27.990870 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:27.990846 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6417806e_53c9_4c3b_b377_675ab5b7363e.slice/crio-5294d8724f635005668669371f35a581c4139a10ebfe5746a8c8c424cfe1f4bb WatchSource:0}: Error finding container 5294d8724f635005668669371f35a581c4139a10ebfe5746a8c8c424cfe1f4bb: Status 404 returned error can't find the container with id 5294d8724f635005668669371f35a581c4139a10ebfe5746a8c8c424cfe1f4bb Jun 05 14:15:28.085144 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.085103 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:28.085319 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.085300 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:28.085387 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.085375 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:29.08535485 +0000 UTC m=+273.388137323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:28.871167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.871117 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" event={"ID":"6417806e-53c9-4c3b-b377-675ab5b7363e","Type":"ContainerStarted","Data":"5294d8724f635005668669371f35a581c4139a10ebfe5746a8c8c424cfe1f4bb"} Jun 05 14:15:28.872601 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.872537 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" event={"ID":"e6a208ec-0ac8-477b-87c6-f9522bab9d7e","Type":"ContainerStarted","Data":"ad621df643f5c048fc949f0900d0afd3740ca332381d5345172acf665fc4d837"} Jun 05 14:15:28.873838 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.873810 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" event={"ID":"64e81c03-b8c9-4aea-af2c-c2fc87e78600","Type":"ContainerStarted","Data":"b370a77fe8c6f4759590f57761b9498470971eadeedc61cde0f1968b7935c6c2"} Jun 05 14:15:28.994019 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.993899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:28.994019 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.994022 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.994096 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:30.99407246 +0000 UTC m=+275.296854946 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : configmap references non-existent config key: service-ca.crt Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.994153 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.994222 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:30.994191982 +0000 UTC m=+275.296974453 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : secret "router-metrics-certs-default" not found Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:28.994152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.994236 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 14:15:28.994302 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:28.994274 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls podName:947e4e11-4925-4d81-9ca8-22466e1901fe nodeName:}" failed. No retries permitted until 2026-06-05 14:15:30.994261502 +0000 UTC m=+275.297043977 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mcgww" (UID: "947e4e11-4925-4d81-9ca8-22466e1901fe") : secret "samples-operator-tls" not found Jun 05 14:15:29.095801 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:29.095712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:29.095994 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:29.095881 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:29.095994 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:29.095962 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:31.095940996 +0000 UTC m=+275.398723470 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:29.879160 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:29.879122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" event={"ID":"a5207cd3-3728-46ba-8513-d4c9cad0a269","Type":"ContainerStarted","Data":"54062220f888fb5343c7ced0f43bd6ce161cf8f1deec0fd70c136ca5fd43c4b5"} Jun 05 14:15:29.895274 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:29.895184 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-5z4h9" podStartSLOduration=1.5216199719999999 podStartE2EDuration="2.895164301s" totalImagesPullingTime="1.373544329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:29.895097797 +0000 UTC m=+274.197880293" watchObservedRunningTime="2026-06-05 14:15:29.895164301 +0000 UTC m=+274.197946795" Jun 05 14:15:29.969920 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:29.969864 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:31.011895 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.011857 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.011925 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.012000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.012036 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.012112 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:35.012092286 +0000 UTC m=+279.314874774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : secret "router-metrics-certs-default" not found Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.012131 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:35.01212133 +0000 UTC m=+279.314903805 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : configmap references non-existent config key: service-ca.crt Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.012108 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 14:15:31.012358 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.012245 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls podName:947e4e11-4925-4d81-9ca8-22466e1901fe nodeName:}" failed. No retries permitted until 2026-06-05 14:15:35.012225146 +0000 UTC m=+279.315007622 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mcgww" (UID: "947e4e11-4925-4d81-9ca8-22466e1901fe") : secret "samples-operator-tls" not found Jun 05 14:15:31.113165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.113125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:31.113380 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.113290 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:31.113380 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:31.113368 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:35.11334706 +0000 UTC m=+279.416129536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:31.887551 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.887510 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" event={"ID":"64e81c03-b8c9-4aea-af2c-c2fc87e78600","Type":"ContainerStarted","Data":"5e06ac719618006db22bd61f7fcce743ad8864710ab5596614a6899cc1ee3651"} Jun 05 14:15:31.889218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.889180 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/0.log" Jun 05 14:15:31.889334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.889235 2575 generic.go:356] "Generic (PLEG): container finished" podID="6417806e-53c9-4c3b-b377-675ab5b7363e" containerID="1711b62202f32e05965f3349a33611872651888b2b63a245bb5ede10abc79903" exitCode=255 Jun 05 14:15:31.889334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.889311 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" event={"ID":"6417806e-53c9-4c3b-b377-675ab5b7363e","Type":"ContainerDied","Data":"1711b62202f32e05965f3349a33611872651888b2b63a245bb5ede10abc79903"} Jun 05 14:15:31.889506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.889488 2575 scope.go:117] "RemoveContainer" containerID="1711b62202f32e05965f3349a33611872651888b2b63a245bb5ede10abc79903" Jun 05 14:15:31.890793 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.890770 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" event={"ID":"e6a208ec-0ac8-477b-87c6-f9522bab9d7e","Type":"ContainerStarted","Data":"869aea6b09a04e9d99361c85b706565d21537b3760d349ce66e07192698f3670"} Jun 05 14:15:31.905223 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.905157 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" podStartSLOduration=2.039008788 podStartE2EDuration="4.905146189s" totalImagesPullingTime="2.866137401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:31.903058387 +0000 UTC m=+276.205840880" watchObservedRunningTime="2026-06-05 14:15:31.905146189 +0000 UTC m=+276.207928682" Jun 05 14:15:31.918993 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:31.918948 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" podStartSLOduration=2.038793842 podStartE2EDuration="4.918932516s" totalImagesPullingTime="2.880138674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:31.918081262 +0000 UTC m=+276.220863755" watchObservedRunningTime="2026-06-05 14:15:31.918932516 +0000 UTC m=+276.221715008" Jun 05 14:15:32.346893 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.346857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.403793 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.403759 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.530660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.530626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.598471 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.598442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.652945 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.652915 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.784706 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.784664 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.840615 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.840586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:32.895331 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.895268 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:15:32.895688 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.895674 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/0.log" Jun 05 14:15:32.895733 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.895706 2575 generic.go:356] "Generic (PLEG): container finished" podID="6417806e-53c9-4c3b-b377-675ab5b7363e" containerID="a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7" exitCode=255 Jun 05 14:15:32.895795 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.895781 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" event={"ID":"6417806e-53c9-4c3b-b377-675ab5b7363e","Type":"ContainerDied","Data":"a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7"} Jun 05 14:15:32.895848 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.895835 2575 scope.go:117] "RemoveContainer" containerID="1711b62202f32e05965f3349a33611872651888b2b63a245bb5ede10abc79903" Jun 05 14:15:32.896052 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:32.896032 2575 scope.go:117] "RemoveContainer" containerID="a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7" Jun 05 14:15:32.896237 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:32.896217 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hgbfn_openshift-console-operator(6417806e-53c9-4c3b-b377-675ab5b7363e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" podUID="6417806e-53c9-4c3b-b377-675ab5b7363e" Jun 05 14:15:33.165509 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:33.165428 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:33.263864 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:33.263831 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:33.900879 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:33.900853 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:15:33.901273 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:33.901175 2575 scope.go:117] "RemoveContainer" containerID="a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7" Jun 05 14:15:33.901344 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:33.901326 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hgbfn_openshift-console-operator(6417806e-53c9-4c3b-b377-675ab5b7363e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" podUID="6417806e-53c9-4c3b-b377-675ab5b7363e" Jun 05 14:15:34.658270 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.658240 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-p9l8m"] Jun 05 14:15:34.662541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.662521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.664923 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.664904 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 05 14:15:34.665059 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.665040 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 05 14:15:34.666165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.666148 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 05 14:15:34.666165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.666160 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-k82dm\"" Jun 05 14:15:34.666307 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.666175 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 05 14:15:34.668652 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.668632 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-p9l8m"] Jun 05 14:15:34.672659 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.672638 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:34.744405 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.744368 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pchx\" (UniqueName: \"kubernetes.io/projected/17bbfa81-59ed-4e99-9242-883987773c46-kube-api-access-2pchx\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.744405 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.744405 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17bbfa81-59ed-4e99-9242-883987773c46-signing-cabundle\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.744615 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.744549 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17bbfa81-59ed-4e99-9242-883987773c46-signing-key\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.772084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.772048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:34.845395 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.845359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17bbfa81-59ed-4e99-9242-883987773c46-signing-key\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.845558 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.845409 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pchx\" (UniqueName: \"kubernetes.io/projected/17bbfa81-59ed-4e99-9242-883987773c46-kube-api-access-2pchx\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.845558 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.845435 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17bbfa81-59ed-4e99-9242-883987773c46-signing-cabundle\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.846111 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.846090 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/17bbfa81-59ed-4e99-9242-883987773c46-signing-cabundle\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.847776 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.847753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/17bbfa81-59ed-4e99-9242-883987773c46-signing-key\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.853675 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.853656 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pchx\" (UniqueName: \"kubernetes.io/projected/17bbfa81-59ed-4e99-9242-883987773c46-kube-api-access-2pchx\") pod \"service-ca-7d74d578b8-p9l8m\" (UID: \"17bbfa81-59ed-4e99-9242-883987773c46\") " pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:34.972476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:34.972397 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" Jun 05 14:15:35.046992 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.046953 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:35.047167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.047040 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:35.047167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.047089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:35.047322 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.047168 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:43.047144322 +0000 UTC m=+287.349926794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : configmap references non-existent config key: service-ca.crt Jun 05 14:15:35.047322 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.047181 2575 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 05 14:15:35.047322 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.047249 2575 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 05 14:15:35.047322 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.047258 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs podName:bcca4fde-001e-4fbb-a070-57978e55379e nodeName:}" failed. No retries permitted until 2026-06-05 14:15:43.0472461 +0000 UTC m=+287.350028586 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs") pod "router-default-cdc78777f-kkqpt" (UID: "bcca4fde-001e-4fbb-a070-57978e55379e") : secret "router-metrics-certs-default" not found Jun 05 14:15:35.047322 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.047303 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls podName:947e4e11-4925-4d81-9ca8-22466e1901fe nodeName:}" failed. No retries permitted until 2026-06-05 14:15:43.047286999 +0000 UTC m=+287.350069488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-mcgww" (UID: "947e4e11-4925-4d81-9ca8-22466e1901fe") : secret "samples-operator-tls" not found Jun 05 14:15:35.094830 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.094789 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-p9l8m"] Jun 05 14:15:35.097435 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:35.097400 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17bbfa81_59ed_4e99_9242_883987773c46.slice/crio-3ae6423a115e7da4ec42684c9e38eda59a95ca2d02bfc26de186981e3a27586b WatchSource:0}: Error finding container 3ae6423a115e7da4ec42684c9e38eda59a95ca2d02bfc26de186981e3a27586b: Status 404 returned error can't find the container with id 3ae6423a115e7da4ec42684c9e38eda59a95ca2d02bfc26de186981e3a27586b Jun 05 14:15:35.148276 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.148251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:35.148406 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.148388 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:35.148467 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:35.148458 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:43.148443288 +0000 UTC m=+287.451225759 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:35.696298 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.696260 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:35.874906 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.874879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpbd5_3fdd4cf1-9bbc-4949-877f-2f14852b404f/dns-node-resolver/0.log" Jun 05 14:15:35.908017 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.907984 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" event={"ID":"17bbfa81-59ed-4e99-9242-883987773c46","Type":"ContainerStarted","Data":"1fa1fede7a7c4546e838939b3ed7e4fc126f6ca3acb1751d79c529201f261f9f"} Jun 05 14:15:35.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.908032 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" event={"ID":"17bbfa81-59ed-4e99-9242-883987773c46","Type":"ContainerStarted","Data":"3ae6423a115e7da4ec42684c9e38eda59a95ca2d02bfc26de186981e3a27586b"} Jun 05 14:15:35.925878 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:35.925830 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-p9l8m" podStartSLOduration=1.925814908 podStartE2EDuration="1.925814908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:35.925290534 +0000 UTC m=+280.228073030" watchObservedRunningTime="2026-06-05 14:15:35.925814908 +0000 UTC m=+280.228597401" Jun 05 14:15:36.737172 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:36.737111 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.022412 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.022316 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.074629 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.074604 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqk5n_a30f8f32-4b1a-4b12-9d24-dba98634a0ae/node-ca/0.log" Jun 05 14:15:37.085133 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.085091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.203958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.203910 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.311879 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.311778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.367180 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.367147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.451962 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.451921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:37.607241 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:37.607184 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-966l6" podUID="3acd96f0-ac8e-4314-87b0-92323f4d8d7f" Jun 05 14:15:37.607241 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:37.607183 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" podUID="074af4a4-705c-4771-a709-a4042e91335d" Jun 05 14:15:37.674862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.674836 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rb546_76018a2b-b732-4ab4-a180-601527a27ef4/serve-healthcheck-canary/0.log" Jun 05 14:15:37.852917 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.852879 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:37.853302 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.852943 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:37.853302 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.853296 2575 scope.go:117] "RemoveContainer" containerID="a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7" Jun 05 14:15:37.853464 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:37.853445 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-hgbfn_openshift-console-operator(6417806e-53c9-4c3b-b377-675ab5b7363e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" podUID="6417806e-53c9-4c3b-b377-675ab5b7363e" Jun 05 14:15:37.913434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.913356 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:15:37.913580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:37.913358 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-966l6" Jun 05 14:15:38.249685 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:38.249581 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:38.476180 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:38.476134 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-8t4hd_64e81c03-b8c9-4aea-af2c-c2fc87e78600/kube-storage-version-migrator-operator/0.log" Jun 05 14:15:38.625110 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:38.625045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:38.684645 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:38.684609 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:39.043941 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:39.043850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:39.438454 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:39.438416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:39.639476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:39.639442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:40.043047 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.043008 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:40.593464 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.593426 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:15:40.593907 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.593528 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:15:40.595778 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.595753 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3acd96f0-ac8e-4314-87b0-92323f4d8d7f-metrics-tls\") pod \"dns-default-966l6\" (UID: \"3acd96f0-ac8e-4314-87b0-92323f4d8d7f\") " pod="openshift-dns/dns-default-966l6" Jun 05 14:15:40.595920 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.595867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"image-registry-8ffbcf74b-786dg\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:15:40.618165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.618143 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-ksmwl\"" Jun 05 14:15:40.618303 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.618193 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-h6w5w\"" Jun 05 14:15:40.625500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.625483 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-966l6" Jun 05 14:15:40.625584 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.625575 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:15:40.643389 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.643359 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:40.743757 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.743727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:40.768409 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.768275 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-966l6"] Jun 05 14:15:40.770582 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:40.770555 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3acd96f0_ac8e_4314_87b0_92323f4d8d7f.slice/crio-2607dba79f493b3b315394f8bc74480365ca7a35ebe6d2c489fc6f8cf0785fc5 WatchSource:0}: Error finding container 2607dba79f493b3b315394f8bc74480365ca7a35ebe6d2c489fc6f8cf0785fc5: Status 404 returned error can't find the container with id 2607dba79f493b3b315394f8bc74480365ca7a35ebe6d2c489fc6f8cf0785fc5 Jun 05 14:15:40.783851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.783820 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:15:40.786988 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:40.786966 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod074af4a4_705c_4771_a709_a4042e91335d.slice/crio-2644ff123c23727d8157e3363f352baa963b49108cc4ec371dac86b54bbfb650 WatchSource:0}: Error finding container 2644ff123c23727d8157e3363f352baa963b49108cc4ec371dac86b54bbfb650: Status 404 returned error can't find the container with id 2644ff123c23727d8157e3363f352baa963b49108cc4ec371dac86b54bbfb650 Jun 05 14:15:40.925722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.925631 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" event={"ID":"074af4a4-705c-4771-a709-a4042e91335d","Type":"ContainerStarted","Data":"3a593017302b7d71f66a0559bc2ca265cdd3c074308840e9ac83eb9811a16517"} Jun 05 14:15:40.925722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.925685 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" event={"ID":"074af4a4-705c-4771-a709-a4042e91335d","Type":"ContainerStarted","Data":"2644ff123c23727d8157e3363f352baa963b49108cc4ec371dac86b54bbfb650"} Jun 05 14:15:40.925722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.925716 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:15:40.926815 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.926788 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-966l6" event={"ID":"3acd96f0-ac8e-4314-87b0-92323f4d8d7f","Type":"ContainerStarted","Data":"2607dba79f493b3b315394f8bc74480365ca7a35ebe6d2c489fc6f8cf0785fc5"} Jun 05 14:15:40.944988 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:40.944942 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" podStartSLOduration=284.944928325 podStartE2EDuration="4m44.944928325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:40.943964427 +0000 UTC m=+285.246746919" watchObservedRunningTime="2026-06-05 14:15:40.944928325 +0000 UTC m=+285.247710817" Jun 05 14:15:41.041571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:41.041538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:41.251999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:41.251870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:41.637874 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:41.637817 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:41.928888 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:41.928801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:42.437259 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.437227 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:42.642181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.642154 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:42.934502 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.934466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-966l6" event={"ID":"3acd96f0-ac8e-4314-87b0-92323f4d8d7f","Type":"ContainerStarted","Data":"731327ce7d98019f1c507700aff267fc677118a1de5165923e975018a78df3ec"} Jun 05 14:15:42.934661 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.934552 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-966l6" event={"ID":"3acd96f0-ac8e-4314-87b0-92323f4d8d7f","Type":"ContainerStarted","Data":"562fc9fb2d9e7bae700decc0ad052226702c42cfeb4c7e77bc3e3dece8032d47"} Jun 05 14:15:42.934661 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.934592 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-966l6" Jun 05 14:15:42.951257 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:42.951160 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-966l6" podStartSLOduration=251.080333509 podStartE2EDuration="4m12.951148207s" totalImagesPullingTime="1.870814698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:11:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:42.950625551 +0000 UTC m=+287.253408042" watchObservedRunningTime="2026-06-05 14:15:42.951148207 +0000 UTC m=+287.253930698" Jun 05 14:15:43.043491 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.043458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:43.116212 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.116170 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:43.116385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.116258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:43.116385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.116307 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:43.116892 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.116872 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcca4fde-001e-4fbb-a070-57978e55379e-service-ca-bundle\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:43.119124 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.119103 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcca4fde-001e-4fbb-a070-57978e55379e-metrics-certs\") pod \"router-default-cdc78777f-kkqpt\" (UID: \"bcca4fde-001e-4fbb-a070-57978e55379e\") " pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:43.119191 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.119175 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/947e4e11-4925-4d81-9ca8-22466e1901fe-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-mcgww\" (UID: \"947e4e11-4925-4d81-9ca8-22466e1901fe\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:43.217585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.217500 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:43.217716 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:43.217653 2575 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:43.217754 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:43.217715 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls podName:ca78d1d5-ddb9-445e-9f37-be8a73a03577 nodeName:}" failed. No retries permitted until 2026-06-05 14:15:59.217698648 +0000 UTC m=+303.520481138 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-dw8cp" (UID: "ca78d1d5-ddb9-445e-9f37-be8a73a03577") : secret "cluster-monitoring-operator-tls" not found Jun 05 14:15:43.244075 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.244040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:43.269334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.269305 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" Jun 05 14:15:43.273678 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.273645 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:43.294959 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.294097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:43.419841 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.419747 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww"] Jun 05 14:15:43.439722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.439584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-cdc78777f-kkqpt"] Jun 05 14:15:43.442936 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:43.442912 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcca4fde_001e_4fbb_a070_57978e55379e.slice/crio-96f932bba50e6d61915bf954c43471eac8863c6dee51e796f72da3a97e867215 WatchSource:0}: Error finding container 96f932bba50e6d61915bf954c43471eac8863c6dee51e796f72da3a97e867215: Status 404 returned error can't find the container with id 96f932bba50e6d61915bf954c43471eac8863c6dee51e796f72da3a97e867215 Jun 05 14:15:43.642215 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.642163 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:43.940603 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.940562 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cdc78777f-kkqpt" event={"ID":"bcca4fde-001e-4fbb-a070-57978e55379e","Type":"ContainerStarted","Data":"7ad6f09e24ff558995793d4b43e8ce8819eaac5097bbce33edbb3193ad4c2f1e"} Jun 05 14:15:43.940794 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.940621 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-cdc78777f-kkqpt" event={"ID":"bcca4fde-001e-4fbb-a070-57978e55379e","Type":"ContainerStarted","Data":"96f932bba50e6d61915bf954c43471eac8863c6dee51e796f72da3a97e867215"} Jun 05 14:15:43.941958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.941928 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" event={"ID":"947e4e11-4925-4d81-9ca8-22466e1901fe","Type":"ContainerStarted","Data":"e05832e3e87c9b6e438694163a6363e5480677bfa6a873f322d42986ec9ce37a"} Jun 05 14:15:43.957614 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:43.957563 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-cdc78777f-kkqpt" podStartSLOduration=16.957547766 podStartE2EDuration="16.957547766s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:43.957355236 +0000 UTC m=+288.260137728" watchObservedRunningTime="2026-06-05 14:15:43.957547766 +0000 UTC m=+288.260330257" Jun 05 14:15:44.248001 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.247880 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:44.274430 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.274397 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:44.277602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.277581 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:44.636704 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.636671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:44.841464 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.841425 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:44.946542 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.946465 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:44.947849 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:44.947815 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-cdc78777f-kkqpt" Jun 05 14:15:45.245350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.245244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:45.531728 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.531684 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:45.840410 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.840378 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:45.952074 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.952037 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" event={"ID":"947e4e11-4925-4d81-9ca8-22466e1901fe","Type":"ContainerStarted","Data":"26803b8bf00c757e388dc338fd177086388252a1603035b31b306bbe326639cf"} Jun 05 14:15:45.952542 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.952098 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" event={"ID":"947e4e11-4925-4d81-9ca8-22466e1901fe","Type":"ContainerStarted","Data":"a98d518352a95d9fe32202fdb8da3db457956292ee41ba7f5a8e1b071585a92e"} Jun 05 14:15:45.969092 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:45.969048 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-mcgww" podStartSLOduration=17.032356062 podStartE2EDuration="18.969031862s" totalImagesPullingTime="1.9366758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:45.96811645 +0000 UTC m=+290.270898952" watchObservedRunningTime="2026-06-05 14:15:45.969031862 +0000 UTC m=+290.271814354" Jun 05 14:15:46.438419 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:46.438377 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:46.641542 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:46.641508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:46.837901 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:46.837871 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:46.899349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:46.899318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:47.036078 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:47.036039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:47.243529 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:47.243423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:47.439452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:47.439416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:52.121657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.121616 2575 scope.go:117] "RemoveContainer" containerID="a6aceaef8bce85ef9cf2ce7cd803aea4c2ba6ac78005b8b4340c8cf2929c0fc7" Jun 05 14:15:52.827571 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.827536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:52.928512 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.928472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:52.943993 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.943968 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-966l6" Jun 05 14:15:52.975263 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.975242 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:15:52.975387 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.975323 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" event={"ID":"6417806e-53c9-4c3b-b377-675ab5b7363e","Type":"ContainerStarted","Data":"6443b24a65aab25dfad45b9257f7b7c0880cafb890ae25ec3b48385a1849a21e"} Jun 05 14:15:52.975628 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.975597 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:52.980043 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.980023 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" Jun 05 14:15:52.981065 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.981038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:52.994214 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:52.994163 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-hgbfn" podStartSLOduration=22.637781753 podStartE2EDuration="25.994149134s" totalImagesPullingTime="3.356367381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:52.992985558 +0000 UTC m=+297.295768067" watchObservedRunningTime="2026-06-05 14:15:52.994149134 +0000 UTC m=+297.296931624" Jun 05 14:15:53.121181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.121073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.121971 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:15:53.121947 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2flc8" podUID="f5bf7c05-0c41-4323-9d35-d5d1e416baea" Jun 05 14:15:53.437920 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.437828 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-6gzvr"] Jun 05 14:15:53.444967 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.444939 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:15:53.447660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.447633 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 14:15:53.447988 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.447962 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-pkrcc\"" Jun 05 14:15:53.448072 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.447998 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 14:15:53.455783 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.455760 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6gzvr"] Jun 05 14:15:53.531676 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.531645 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n9gr5"] Jun 05 14:15:53.535913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.535893 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.538722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.538705 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-nvvsg\"" Jun 05 14:15:53.538902 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.538890 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 14:15:53.539942 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.539923 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 14:15:53.540070 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.539948 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 14:15:53.540070 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.540018 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 14:15:53.541713 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.541685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.550235 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.550213 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9gr5"] Jun 05 14:15:53.600737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.600698 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m5bz\" (UniqueName: \"kubernetes.io/projected/c83887bd-846e-4827-b64a-e1bd785d1005-kube-api-access-7m5bz\") pod \"downloads-6657875f97-6gzvr\" (UID: \"c83887bd-846e-4827-b64a-e1bd785d1005\") " pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:15:53.642099 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.642052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.701660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701576 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.701660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701610 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.701660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-crio-socket\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.702006 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701732 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-data-volume\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.702006 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701771 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4wk\" (UniqueName: \"kubernetes.io/projected/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-api-access-6z4wk\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.702006 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.701814 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m5bz\" (UniqueName: \"kubernetes.io/projected/c83887bd-846e-4827-b64a-e1bd785d1005-kube-api-access-7m5bz\") pod \"downloads-6657875f97-6gzvr\" (UID: \"c83887bd-846e-4827-b64a-e1bd785d1005\") " pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:15:53.710012 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.709992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m5bz\" (UniqueName: \"kubernetes.io/projected/c83887bd-846e-4827-b64a-e1bd785d1005-kube-api-access-7m5bz\") pod \"downloads-6657875f97-6gzvr\" (UID: \"c83887bd-846e-4827-b64a-e1bd785d1005\") " pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:15:53.744296 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.744264 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.755511 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.755485 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:15:53.803154 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803118 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-crio-socket\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803379 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-data-volume\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803379 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4wk\" (UniqueName: \"kubernetes.io/projected/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-api-access-6z4wk\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803379 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803261 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803379 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803265 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-crio-socket\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803379 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803282 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803497 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-data-volume\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.803853 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.803824 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.805775 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.805751 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.812622 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.812598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4wk\" (UniqueName: \"kubernetes.io/projected/d569362d-8cc8-4d27-8e5c-7295b1aeaaaf-kube-api-access-6z4wk\") pod \"insights-runtime-extractor-n9gr5\" (UID: \"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf\") " pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.845604 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.845569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n9gr5" Jun 05 14:15:53.891606 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.891568 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-6gzvr"] Jun 05 14:15:53.894517 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:53.894489 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc83887bd_846e_4827_b64a_e1bd785d1005.slice/crio-7a75036ae188f4d1bcc9c83835f2686c35417972abf1f966f04fd3d5c8ed0b97 WatchSource:0}: Error finding container 7a75036ae188f4d1bcc9c83835f2686c35417972abf1f966f04fd3d5c8ed0b97: Status 404 returned error can't find the container with id 7a75036ae188f4d1bcc9c83835f2686c35417972abf1f966f04fd3d5c8ed0b97 Jun 05 14:15:53.907473 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.907429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.964026 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.963944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:53.979627 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.979592 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6gzvr" event={"ID":"c83887bd-846e-4827-b64a-e1bd785d1005","Type":"ContainerStarted","Data":"7a75036ae188f4d1bcc9c83835f2686c35417972abf1f966f04fd3d5c8ed0b97"} Jun 05 14:15:53.981603 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:53.981584 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n9gr5"] Jun 05 14:15:53.984103 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:53.984078 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd569362d_8cc8_4d27_8e5c_7295b1aeaaaf.slice/crio-32f8343c103bb1fa07b0b560f8970fbc5d306759547f949188546aed44adf90e WatchSource:0}: Error finding container 32f8343c103bb1fa07b0b560f8970fbc5d306759547f949188546aed44adf90e: Status 404 returned error can't find the container with id 32f8343c103bb1fa07b0b560f8970fbc5d306759547f949188546aed44adf90e Jun 05 14:15:54.307504 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:54.307416 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:54.510008 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:54.509981 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:54.613023 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:54.612940 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:54.986082 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:54.986001 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9gr5" event={"ID":"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf","Type":"ContainerStarted","Data":"8457ea87ce0f1523b1fc9673ac8bed4fb7fda0d260b927a6cc9560bc4eb29650"} Jun 05 14:15:54.986082 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:54.986067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9gr5" event={"ID":"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf","Type":"ContainerStarted","Data":"32f8343c103bb1fa07b0b560f8970fbc5d306759547f949188546aed44adf90e"} Jun 05 14:15:55.992741 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:55.992700 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9gr5" event={"ID":"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf","Type":"ContainerStarted","Data":"8c6239a4c425b9745b815c5e84d50c34957a6c2846e5d6a235d6e9e15cd4c4b6"} Jun 05 14:15:56.070172 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.070139 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:15:56.071522 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.071497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:15:56.086664 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.086640 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:15:56.087516 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.087458 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:15:56.089862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.089831 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 14:15:56.132430 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.132283 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:56.733687 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:56.233135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:15:58.002749 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:58.002707 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n9gr5" event={"ID":"d569362d-8cc8-4d27-8e5c-7295b1aeaaaf","Type":"ContainerStarted","Data":"f3795cb1de3b7ba337a8076b625463d2d2539d9461c766b1699fe1b0e02bfb85"} Jun 05 14:15:58.021178 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:58.021127 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n9gr5" podStartSLOduration=2.197418487 podStartE2EDuration="5.021111101s" totalImagesPullingTime="2.823692614s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 14:15:53 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:15:58.020547347 +0000 UTC m=+302.323329840" watchObservedRunningTime="2026-06-05 14:15:58.021111101 +0000 UTC m=+302.323893591" Jun 05 14:15:59.254212 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.254152 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:59.257143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.257117 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ca78d1d5-ddb9-445e-9f37-be8a73a03577-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-dw8cp\" (UID: \"ca78d1d5-ddb9-445e-9f37-be8a73a03577\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:59.554461 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.554374 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-xhwcb\"" Jun 05 14:15:59.561918 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.561890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" Jun 05 14:15:59.711752 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.711709 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp"] Jun 05 14:15:59.715165 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:15:59.715130 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca78d1d5_ddb9_445e_9f37_be8a73a03577.slice/crio-8d6e4436eef1b62b2c95bbb837e968b58ac613f4ea8c91942911142a61bbd935 WatchSource:0}: Error finding container 8d6e4436eef1b62b2c95bbb837e968b58ac613f4ea8c91942911142a61bbd935: Status 404 returned error can't find the container with id 8d6e4436eef1b62b2c95bbb837e968b58ac613f4ea8c91942911142a61bbd935 Jun 05 14:15:59.717636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:15:59.717615 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:16:00.014110 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:00.014067 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" event={"ID":"ca78d1d5-ddb9-445e-9f37-be8a73a03577","Type":"ContainerStarted","Data":"8d6e4436eef1b62b2c95bbb837e968b58ac613f4ea8c91942911142a61bbd935"} Jun 05 14:16:00.632013 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:00.631964 2575 patch_prober.go:28] interesting pod/image-registry-8ffbcf74b-786dg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 05 14:16:00.632464 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:00.632030 2575 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" podUID="074af4a4-705c-4771-a709-a4042e91335d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 05 14:16:01.592893 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.592834 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:01.752746 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.752709 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7"] Jun 05 14:16:01.756590 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.756567 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:01.759257 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.759230 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qvzcq\"" Jun 05 14:16:01.759386 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.759277 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 05 14:16:01.766220 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.765779 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7"] Jun 05 14:16:01.880181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.880092 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c470bf1c-d948-435a-b521-8dbe64d0c4d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tb2p7\" (UID: \"c470bf1c-d948-435a-b521-8dbe64d0c4d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:01.935939 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.935904 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:16:01.981374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.981330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c470bf1c-d948-435a-b521-8dbe64d0c4d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tb2p7\" (UID: \"c470bf1c-d948-435a-b521-8dbe64d0c4d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:01.984236 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:01.984188 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c470bf1c-d948-435a-b521-8dbe64d0c4d6-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-tb2p7\" (UID: \"c470bf1c-d948-435a-b521-8dbe64d0c4d6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:02.024024 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:02.023982 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" event={"ID":"ca78d1d5-ddb9-445e-9f37-be8a73a03577","Type":"ContainerStarted","Data":"f07151fd61f0fa8cb6518e67aa4f74e73b171bb91c6caf9fc06fbe7fa15b7c90"} Jun 05 14:16:02.041226 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:02.041106 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-dw8cp" podStartSLOduration=33.501219547 podStartE2EDuration="35.041086596s" totalImagesPullingTime="1.539867049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:02.040351745 +0000 UTC m=+306.343134249" watchObservedRunningTime="2026-06-05 14:16:02.041086596 +0000 UTC m=+306.343869088" Jun 05 14:16:02.069218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:02.069142 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:02.213487 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:02.213408 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7"] Jun 05 14:16:02.216640 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:16:02.216608 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc470bf1c_d948_435a_b521_8dbe64d0c4d6.slice/crio-d22846d657023de8b539f94b90a5cf76a09cd9a05ace225054f2c5c565285539 WatchSource:0}: Error finding container d22846d657023de8b539f94b90a5cf76a09cd9a05ace225054f2c5c565285539: Status 404 returned error can't find the container with id d22846d657023de8b539f94b90a5cf76a09cd9a05ace225054f2c5c565285539 Jun 05 14:16:03.029124 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:03.029084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" event={"ID":"c470bf1c-d948-435a-b521-8dbe64d0c4d6","Type":"ContainerStarted","Data":"d22846d657023de8b539f94b90a5cf76a09cd9a05ace225054f2c5c565285539"} Jun 05 14:16:03.249801 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:03.249741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:04.034968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.034926 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" event={"ID":"c470bf1c-d948-435a-b521-8dbe64d0c4d6","Type":"ContainerStarted","Data":"ad31bd0bb8651a9cc8623a698de34dd2fed6ae6509af6f24d82c34fc53c1492b"} Jun 05 14:16:04.035467 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.035098 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:04.041619 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.041595 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" Jun 05 14:16:04.051885 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.051820 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-tb2p7" podStartSLOduration=2.028576234 podStartE2EDuration="3.051799763s" totalImagesPullingTime="1.023223529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:16:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:04.050340549 +0000 UTC m=+308.353123053" watchObservedRunningTime="2026-06-05 14:16:04.051799763 +0000 UTC m=+308.354582256" Jun 05 14:16:04.777523 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.777473 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:04.840491 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.840454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:04.911585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:04.911542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:06.134282 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.134242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:06.135347 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.135314 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:06.139675 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.139654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.143588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.143566 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 14:16:06.143681 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.143568 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 14:16:06.143681 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.143641 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7ld8t\"" Jun 05 14:16:06.143792 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.143693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 14:16:06.143792 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.143764 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 14:16:06.144084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.144067 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 14:16:06.148872 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.148639 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 05 14:16:06.149672 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.149651 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:06.192707 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.192668 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:06.215900 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.215864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.215900 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.215902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.216107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.215952 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.216107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.216016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.216107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.216063 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.216107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.216105 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.216287 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.216132 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5fzn\" (UniqueName: \"kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317128 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5fzn\" (UniqueName: \"kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317137 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317165 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317270 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317328 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317309 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.317580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317357 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.318051 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.317983 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.318186 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.318050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.318276 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.318242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.318331 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.318295 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.320299 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.320257 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.320417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.320351 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.325468 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.325446 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5fzn\" (UniqueName: \"kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn\") pod \"console-6d4556fd7d-jljxr\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:06.452095 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:06.451996 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:07.214527 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:07.214484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:08.121252 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:08.121219 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:16:08.753101 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:08.753066 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:08.807788 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:08.807749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:09.335309 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:09.335238 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:09.387552 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:09.387516 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:09.908221 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:09.908168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.130509 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.130431 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.154133 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.154059 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx"] Jun 05 14:16:10.157985 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.157953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.161738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.161320 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 14:16:10.161738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.161370 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 14:16:10.161738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.161540 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b85gf\"" Jun 05 14:16:10.162594 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.162438 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 14:16:10.162714 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.162352 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 14:16:10.171971 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.171945 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx"] Jun 05 14:16:10.180758 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.180726 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-tqt2m"] Jun 05 14:16:10.184635 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.184609 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.187503 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.187485 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qjpq7\"" Jun 05 14:16:10.188067 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.188048 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 14:16:10.188619 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.188602 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 14:16:10.189046 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.189028 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 14:16:10.210029 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.209999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.250411 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250359 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8faef627-d4ce-45f1-9325-c910a6c3c274-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.250411 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250407 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250439 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-wtmp\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ns7b\" (UniqueName: \"kubernetes.io/projected/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-api-access-5ns7b\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250501 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250562 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-sys\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250587 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.250638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250619 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250644 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-root\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250700 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-textfile\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-metrics-client-ca\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250750 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f74ng\" (UniqueName: \"kubernetes.io/projected/5363541f-fa69-48bc-8415-ed5f153fa40c-kube-api-access-f74ng\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.251004 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.250785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.282506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.282472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.351585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351544 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.351782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351601 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-sys\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.351782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.351782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351667 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.351782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351695 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-root\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.351782 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.351712 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 14:16:10.352054 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.351790 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls podName:5363541f-fa69-48bc-8415-ed5f153fa40c nodeName:}" failed. No retries permitted until 2026-06-05 14:16:10.851768243 +0000 UTC m=+315.154550719 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls") pod "node-exporter-tqt2m" (UID: "5363541f-fa69-48bc-8415-ed5f153fa40c") : secret "node-exporter-tls" not found Jun 05 14:16:10.352054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351717 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.352054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.351987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-textfile\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.352054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352019 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-metrics-client-ca\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.352054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f74ng\" (UniqueName: \"kubernetes.io/projected/5363541f-fa69-48bc-8415-ed5f153fa40c-kube-api-access-f74ng\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352161 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8faef627-d4ce-45f1-9325-c910a6c3c274-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352193 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352223 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-sys\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352543 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-textfile\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.352628 2575 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.352678 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls podName:8faef627-d4ce-45f1-9325-c910a6c3c274 nodeName:}" failed. No retries permitted until 2026-06-05 14:16:10.852662796 +0000 UTC m=+315.155445268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-2p9mx" (UID: "8faef627-d4ce-45f1-9325-c910a6c3c274") : secret "kube-state-metrics-tls" not found Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352806 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-root\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352895 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352906 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-wtmp\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352935 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ns7b\" (UniqueName: \"kubernetes.io/projected/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-api-access-5ns7b\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.352960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8faef627-d4ce-45f1-9325-c910a6c3c274-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.353037 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.353075 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-wtmp\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.353657 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.353079 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-metrics-client-ca\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.354516 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.353511 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-accelerators-collector-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.356929 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.356854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.357524 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.357462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.365933 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.365869 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ns7b\" (UniqueName: \"kubernetes.io/projected/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-api-access-5ns7b\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.367501 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.367449 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f74ng\" (UniqueName: \"kubernetes.io/projected/5363541f-fa69-48bc-8415-ed5f153fa40c-kube-api-access-f74ng\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.390727 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.386447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.479502 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.479383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.579312 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.579274 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.679118 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.679073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.846896 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.841753 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:10.857756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.857721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.857910 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.857832 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:10.857974 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.857936 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 05 14:16:10.858052 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:10.858038 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls podName:5363541f-fa69-48bc-8415-ed5f153fa40c nodeName:}" failed. No retries permitted until 2026-06-05 14:16:11.858019011 +0000 UTC m=+316.160801502 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls") pod "node-exporter-tqt2m" (UID: "5363541f-fa69-48bc-8415-ed5f153fa40c") : secret "node-exporter-tls" not found Jun 05 14:16:10.860731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.860702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8faef627-d4ce-45f1-9325-c910a6c3c274-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-2p9mx\" (UID: \"8faef627-d4ce-45f1-9325-c910a6c3c274\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:10.944856 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:10.944813 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:11.044399 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.044332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:11.044399 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.044379 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:11.047378 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:16:11.047347 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb5a98f_327a_4214_8101_75ad2b5dc9e4.slice/crio-64713578a80bdef85a06f7aa5d23ba3b086d6f1d823122c11e69275c105d7c26 WatchSource:0}: Error finding container 64713578a80bdef85a06f7aa5d23ba3b086d6f1d823122c11e69275c105d7c26: Status 404 returned error can't find the container with id 64713578a80bdef85a06f7aa5d23ba3b086d6f1d823122c11e69275c105d7c26 Jun 05 14:16:11.063278 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.063247 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4556fd7d-jljxr" event={"ID":"bcb5a98f-327a-4214-8101-75ad2b5dc9e4","Type":"ContainerStarted","Data":"64713578a80bdef85a06f7aa5d23ba3b086d6f1d823122c11e69275c105d7c26"} Jun 05 14:16:11.075374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.075347 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" Jun 05 14:16:11.141774 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.141675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:11.223633 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.222337 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx"] Jun 05 14:16:11.225561 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:16:11.225525 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8faef627_d4ce_45f1_9325_c910a6c3c274.slice/crio-855144f967373928b22d079e63c29e5b223ab00519830f5fbc19e8c92140b6e7 WatchSource:0}: Error finding container 855144f967373928b22d079e63c29e5b223ab00519830f5fbc19e8c92140b6e7: Status 404 returned error can't find the container with id 855144f967373928b22d079e63c29e5b223ab00519830f5fbc19e8c92140b6e7 Jun 05 14:16:11.231248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.231158 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:11.876061 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.875904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:11.895844 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:11.895695 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5363541f-fa69-48bc-8415-ed5f153fa40c-node-exporter-tls\") pod \"node-exporter-tqt2m\" (UID: \"5363541f-fa69-48bc-8415-ed5f153fa40c\") " pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:12.000419 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.000383 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-tqt2m" Jun 05 14:16:12.033646 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.033448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:12.078709 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.078673 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqt2m" event={"ID":"5363541f-fa69-48bc-8415-ed5f153fa40c","Type":"ContainerStarted","Data":"8ea12898c0d7a49873c509622cfa3154c79f2c59cafbaa6c87f12dbae5198e96"} Jun 05 14:16:12.080609 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.080579 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" event={"ID":"8faef627-d4ce-45f1-9325-c910a6c3c274","Type":"ContainerStarted","Data":"855144f967373928b22d079e63c29e5b223ab00519830f5fbc19e8c92140b6e7"} Jun 05 14:16:12.082591 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.082408 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-6gzvr" event={"ID":"c83887bd-846e-4827-b64a-e1bd785d1005","Type":"ContainerStarted","Data":"0a292905af2749dc39bad4a0794aac7138dbbdd82a74263a563150e875f74016"} Jun 05 14:16:12.083394 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.083342 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:16:12.094342 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.094301 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-6gzvr" Jun 05 14:16:12.130713 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:12.129842 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-6gzvr" podStartSLOduration=2.017326773 podStartE2EDuration="19.129822227s" totalImagesPullingTime="17.112495454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:15:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:12.105810936 +0000 UTC m=+316.408593431" watchObservedRunningTime="2026-06-05 14:16:12.129822227 +0000 UTC m=+316.432604721" Jun 05 14:16:13.111330 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:13.111288 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:13.173835 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:13.173773 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:13.551550 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:13.551457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:13.652014 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:13.651669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:14.003590 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.003553 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:14.157058 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.156885 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:14.253975 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.253806 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:14.936430 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.936377 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:14.945903 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.944469 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4"] Jun 05 14:16:14.999776 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.999016 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4"] Jun 05 14:16:14.999776 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:14.999134 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.002381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.002351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-gbfj6\"" Jun 05 14:16:15.002500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.002487 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 05 14:16:15.019148 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.018925 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:15.114145 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.114108 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.114347 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.114230 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvbss\" (UniqueName: \"kubernetes.io/projected/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-kube-api-access-zvbss\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.220258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.220148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvbss\" (UniqueName: \"kubernetes.io/projected/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-kube-api-access-zvbss\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.220695 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.220266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.220695 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:15.220445 2575 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 05 14:16:15.220695 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:15.220518 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert podName:01afa6b0-5352-45fc-ba8a-baa6802c9fe7 nodeName:}" failed. No retries permitted until 2026-06-05 14:16:15.720499994 +0000 UTC m=+320.023282472 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-zl8r4" (UID: "01afa6b0-5352-45fc-ba8a-baa6802c9fe7") : secret "monitoring-plugin-cert" not found Jun 05 14:16:15.231436 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.231386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvbss\" (UniqueName: \"kubernetes.io/projected/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-kube-api-access-zvbss\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.359217 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.359167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:15.726924 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.726885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.729689 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.729663 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01afa6b0-5352-45fc-ba8a-baa6802c9fe7-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zl8r4\" (UID: \"01afa6b0-5352-45fc-ba8a-baa6802c9fe7\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:15.913100 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:15.913072 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:16.064828 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.064636 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:16:16.141502 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.139910 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqt2m" event={"ID":"5363541f-fa69-48bc-8415-ed5f153fa40c","Type":"ContainerStarted","Data":"ed15e2e3f232055b0920c6585e1429ab38bc62ebcfc581c1fe278e199f04367e"} Jun 05 14:16:16.145058 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.142715 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4556fd7d-jljxr" event={"ID":"bcb5a98f-327a-4214-8101-75ad2b5dc9e4","Type":"ContainerStarted","Data":"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241"} Jun 05 14:16:16.146382 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.145555 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" event={"ID":"8faef627-d4ce-45f1-9325-c910a6c3c274","Type":"ContainerStarted","Data":"9e3a4ddf042646e001064fc80d4c89109d9ed70fbed32f3e694abbc9aee2c56b"} Jun 05 14:16:16.148560 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.148349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.189507 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.186262 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4"] Jun 05 14:16:16.189507 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.186914 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d4556fd7d-jljxr" podStartSLOduration=5.3750756840000005 podStartE2EDuration="10.186894597s" totalImagesPullingTime="4.811818913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:16.18182613 +0000 UTC m=+320.484608623" watchObservedRunningTime="2026-06-05 14:16:16.186894597 +0000 UTC m=+320.489677091" Jun 05 14:16:16.246350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.246269 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.401326 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.401173 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.402404 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.402377 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:16:16.421353 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.421324 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.429136 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.427868 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 14:16:16.431139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.430719 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 14:16:16.431139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.430771 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:16:16.431139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.430944 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 14:16:16.431139 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.430973 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 14:16:16.431371 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.431156 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 14:16:16.431371 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.431162 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 14:16:16.431461 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.431399 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2z4vm\"" Jun 05 14:16:16.431828 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.431594 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 14:16:16.431828 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.431772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.432065 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.432351 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-29hsou4pfef2u\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.432490 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.432739 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.433070 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.433544 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.433553 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 14:16:16.433875 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.433703 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 14:16:16.452290 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.452258 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:16.452543 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.452523 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:16.458469 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.458445 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:16.459997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.459973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.536871 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.536830 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.536920 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.536954 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnd2z\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537011 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537038 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537089 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537127 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537150 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537179 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537241 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537309 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537332 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537383 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537432 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537458 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537513 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.537799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.537554 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.638936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.638894 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.638936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.638945 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.638988 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639043 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639099 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639143 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639279 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639331 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639408 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639444 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639472 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnd2z\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639530 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639523 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639914 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639914 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639914 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.639914 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.639654 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.640109 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.640039 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.640182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.640158 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.641409 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.640988 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.641409 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.641013 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.641656 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.641632 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.642822 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.642698 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.644284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.643049 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.644284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.643110 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.644284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.643530 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.644284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.643942 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.644284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.644032 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.644594 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.645031 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.645710 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.645752 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.646403 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.646891 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647575 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.647284 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.647833 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.647811 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.651003 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.650982 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnd2z\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z\") pod \"prometheus-k8s-0\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.736103 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.736013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:16.858801 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.858711 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.922606 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.922567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:16.946485 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:16.946429 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:16:16.950738 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:16:16.950710 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecd34f5_f979_4c98_a4c8_b8fe3560ce0e.slice/crio-b74a73a5b01793660245be0af213a1f531ea90314ce226388814b6814c852e1c WatchSource:0}: Error finding container b74a73a5b01793660245be0af213a1f531ea90314ce226388814b6814c852e1c: Status 404 returned error can't find the container with id b74a73a5b01793660245be0af213a1f531ea90314ce226388814b6814c852e1c Jun 05 14:16:17.151394 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.151352 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"b74a73a5b01793660245be0af213a1f531ea90314ce226388814b6814c852e1c"} Jun 05 14:16:17.152741 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.152702 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" event={"ID":"01afa6b0-5352-45fc-ba8a-baa6802c9fe7","Type":"ContainerStarted","Data":"60db05b8fc1c300a93ac3448b6b688fbc1d60e90fd37d62f03ac23ebd166e019"} Jun 05 14:16:17.154436 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.154405 2575 generic.go:356] "Generic (PLEG): container finished" podID="5363541f-fa69-48bc-8415-ed5f153fa40c" containerID="ed15e2e3f232055b0920c6585e1429ab38bc62ebcfc581c1fe278e199f04367e" exitCode=0 Jun 05 14:16:17.154556 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.154498 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqt2m" event={"ID":"5363541f-fa69-48bc-8415-ed5f153fa40c","Type":"ContainerDied","Data":"ed15e2e3f232055b0920c6585e1429ab38bc62ebcfc581c1fe278e199f04367e"} Jun 05 14:16:17.157840 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.157147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" event={"ID":"8faef627-d4ce-45f1-9325-c910a6c3c274","Type":"ContainerStarted","Data":"529574fe1fd835d47267fd8a1871e3e5b3f7cd93f248bec84f3b7bf3a281ea8e"} Jun 05 14:16:17.157840 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.157218 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" event={"ID":"8faef627-d4ce-45f1-9325-c910a6c3c274","Type":"ContainerStarted","Data":"3af6aaed77c6ebbfa354a1c68659de06dfef08895635083b0f9db32739f7dc20"} Jun 05 14:16:17.162171 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.162113 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:17.219911 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.217793 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-2p9mx" podStartSLOduration=2.591435004 podStartE2EDuration="7.217770805s" totalImagesPullingTime="4.626335801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:17.216516945 +0000 UTC m=+321.519299439" watchObservedRunningTime="2026-06-05 14:16:17.217770805 +0000 UTC m=+321.520553299" Jun 05 14:16:17.837112 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.837020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:17.894349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:17.894313 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:18.168119 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.167514 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqt2m" event={"ID":"5363541f-fa69-48bc-8415-ed5f153fa40c","Type":"ContainerStarted","Data":"211397ac095bae4acdfdef37d07f4f60239327baac8f8ba4e9c41cba51dda93c"} Jun 05 14:16:18.168119 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.167574 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-tqt2m" event={"ID":"5363541f-fa69-48bc-8415-ed5f153fa40c","Type":"ContainerStarted","Data":"569cc4e00a0a6f764d70968a8930c6a61a75b8aa674693ac97d8148c7a75dbf9"} Jun 05 14:16:18.189050 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.188675 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-tqt2m" podStartSLOduration=4.144318288 podStartE2EDuration="8.188653994s" totalImagesPullingTime="3.833491351s" totalInitContainerRuntime="210.844355ms" isStatefulPod=true podCreationTimestamp="2026-06-05 14:16:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:18.18767152 +0000 UTC m=+322.490454014" watchObservedRunningTime="2026-06-05 14:16:18.188653994 +0000 UTC m=+322.491436486" Jun 05 14:16:18.203061 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.203020 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:18.307370 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.307329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:18.505417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:18.505331 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:19.172737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.172694 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476" exitCode=0 Jun 05 14:16:19.173236 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.172797 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476"} Jun 05 14:16:19.174798 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.174755 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" event={"ID":"01afa6b0-5352-45fc-ba8a-baa6802c9fe7","Type":"ContainerStarted","Data":"3e8312591259baa7abdf41a6086128955f71da3d2a24c7c9f7c37dabcec8569b"} Jun 05 14:16:19.175313 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.175293 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:19.180973 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.180947 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" Jun 05 14:16:19.224482 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:19.224431 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zl8r4" podStartSLOduration=2.599323846 podStartE2EDuration="5.224415049s" totalImagesPullingTime="2.625091203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:16:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:19.223028747 +0000 UTC m=+323.525811241" watchObservedRunningTime="2026-06-05 14:16:19.224415049 +0000 UTC m=+323.527197541" Jun 05 14:16:20.599525 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:20.599480 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:22.534993 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:22.534948 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:22.588337 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:22.588302 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:23.197955 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:23.197925 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68"} Jun 05 14:16:23.198118 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:23.197994 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be"} Jun 05 14:16:26.214045 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.214007 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6"} Jun 05 14:16:26.214591 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.214070 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d"} Jun 05 14:16:26.214591 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.214096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d"} Jun 05 14:16:26.214591 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.214119 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerStarted","Data":"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b"} Jun 05 14:16:26.242775 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.242724 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.5715678090000003 podStartE2EDuration="10.242706988s" totalImagesPullingTime="7.643059998s" totalInitContainerRuntime="28.079181ms" isStatefulPod=false podCreationTimestamp="2026-06-05 14:16:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:16:26.240520432 +0000 UTC m=+330.543302926" watchObservedRunningTime="2026-06-05 14:16:26.242706988 +0000 UTC m=+330.545489472" Jun 05 14:16:26.737055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:26.737017 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:16:33.899971 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:33.899935 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:34.010921 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:34.010889 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:34.063082 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:34.063047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:34.115973 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:34.115935 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:41.125780 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.125696 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" podUID="074af4a4-705c-4771-a709-a4042e91335d" containerName="registry" containerID="cri-o://3a593017302b7d71f66a0559bc2ca265cdd3c074308840e9ac83eb9811a16517" gracePeriod=30 Jun 05 14:16:41.273901 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.273864 2575 generic.go:356] "Generic (PLEG): container finished" podID="074af4a4-705c-4771-a709-a4042e91335d" containerID="3a593017302b7d71f66a0559bc2ca265cdd3c074308840e9ac83eb9811a16517" exitCode=0 Jun 05 14:16:41.274063 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.273933 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" event={"ID":"074af4a4-705c-4771-a709-a4042e91335d","Type":"ContainerDied","Data":"3a593017302b7d71f66a0559bc2ca265cdd3c074308840e9ac83eb9811a16517"} Jun 05 14:16:41.380361 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.380305 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:16:41.468544 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468502 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.468544 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468553 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.468758 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468592 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.468799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468757 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.468842 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468815 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.469013 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468970 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.469163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.469030 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tct5t\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.469163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.468980 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:41.469163 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.469091 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets\") pod \"074af4a4-705c-4771-a709-a4042e91335d\" (UID: \"074af4a4-705c-4771-a709-a4042e91335d\") " Jun 05 14:16:41.469373 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.469343 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:41.469432 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.469401 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-registry-certificates\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.471082 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.471051 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:16:41.471192 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.471051 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:16:41.471424 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.471399 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:16:41.471574 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.471550 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t" (OuterVolumeSpecName: "kube-api-access-tct5t") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "kube-api-access-tct5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:16:41.471814 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.471783 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:16:41.477574 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.477544 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "074af4a4-705c-4771-a709-a4042e91335d" (UID: "074af4a4-705c-4771-a709-a4042e91335d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:16:41.570679 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570635 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/074af4a4-705c-4771-a709-a4042e91335d-trusted-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570679 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570669 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tct5t\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-kube-api-access-tct5t\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570679 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570681 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-installation-pull-secrets\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570679 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570690 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-registry-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570949 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570700 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/074af4a4-705c-4771-a709-a4042e91335d-ca-trust-extracted\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570949 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570712 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/074af4a4-705c-4771-a709-a4042e91335d-bound-sa-token\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:41.570949 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:41.570720 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/074af4a4-705c-4771-a709-a4042e91335d-image-registry-private-configuration\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:42.278883 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.278848 2575 generic.go:356] "Generic (PLEG): container finished" podID="e6a208ec-0ac8-477b-87c6-f9522bab9d7e" containerID="869aea6b09a04e9d99361c85b706565d21537b3760d349ce66e07192698f3670" exitCode=0 Jun 05 14:16:42.279348 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.278922 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" event={"ID":"e6a208ec-0ac8-477b-87c6-f9522bab9d7e","Type":"ContainerDied","Data":"869aea6b09a04e9d99361c85b706565d21537b3760d349ce66e07192698f3670"} Jun 05 14:16:42.279348 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.279286 2575 scope.go:117] "RemoveContainer" containerID="869aea6b09a04e9d99361c85b706565d21537b3760d349ce66e07192698f3670" Jun 05 14:16:42.280413 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.280394 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" Jun 05 14:16:42.280413 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.280400 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8ffbcf74b-786dg" event={"ID":"074af4a4-705c-4771-a709-a4042e91335d","Type":"ContainerDied","Data":"2644ff123c23727d8157e3363f352baa963b49108cc4ec371dac86b54bbfb650"} Jun 05 14:16:42.280535 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.280446 2575 scope.go:117] "RemoveContainer" containerID="3a593017302b7d71f66a0559bc2ca265cdd3c074308840e9ac83eb9811a16517" Jun 05 14:16:42.310175 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.310144 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:16:42.317677 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:42.317648 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8ffbcf74b-786dg"] Jun 05 14:16:43.287323 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:43.287289 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-hfbst" event={"ID":"e6a208ec-0ac8-477b-87c6-f9522bab9d7e","Type":"ContainerStarted","Data":"4bc107f8f04aff26b034e2a286f35bdf7379c56fabf1085e4da1fd2f3dce6e44"} Jun 05 14:16:44.125927 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:44.125888 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="074af4a4-705c-4771-a709-a4042e91335d" path="/var/lib/kubelet/pods/074af4a4-705c-4771-a709-a4042e91335d/volumes" Jun 05 14:16:46.835063 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:46.835031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:46.888269 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:46.888242 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:16:47.305680 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:47.305585 2575 generic.go:356] "Generic (PLEG): container finished" podID="64e81c03-b8c9-4aea-af2c-c2fc87e78600" containerID="5e06ac719618006db22bd61f7fcce743ad8864710ab5596614a6899cc1ee3651" exitCode=0 Jun 05 14:16:47.305680 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:47.305669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" event={"ID":"64e81c03-b8c9-4aea-af2c-c2fc87e78600","Type":"ContainerDied","Data":"5e06ac719618006db22bd61f7fcce743ad8864710ab5596614a6899cc1ee3651"} Jun 05 14:16:47.305991 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:47.305975 2575 scope.go:117] "RemoveContainer" containerID="5e06ac719618006db22bd61f7fcce743ad8864710ab5596614a6899cc1ee3651" Jun 05 14:16:48.311470 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:48.311440 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-8t4hd" event={"ID":"64e81c03-b8c9-4aea-af2c-c2fc87e78600","Type":"ContainerStarted","Data":"b7457319fdbf0c914cde77fc6550e2c6becba519f73cf1408d71131115c70560"} Jun 05 14:16:58.920766 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:58.920693 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d4556fd7d-jljxr" podUID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" containerName="console" containerID="cri-o://1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241" gracePeriod=15 Jun 05 14:16:59.195920 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.195834 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:59.345342 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345296 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5fzn\" (UniqueName: \"kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345364 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345399 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345464 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345504 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345746 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345543 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345746 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345574 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config\") pod \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\" (UID: \"bcb5a98f-327a-4214-8101-75ad2b5dc9e4\") " Jun 05 14:16:59.345907 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345878 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:59.345980 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.345922 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:59.346121 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.346070 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca" (OuterVolumeSpecName: "service-ca") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:59.346320 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.346122 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config" (OuterVolumeSpecName: "console-config") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:16:59.347722 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.347698 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:16:59.347805 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.347724 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:16:59.347805 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.347753 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn" (OuterVolumeSpecName: "kube-api-access-n5fzn") pod "bcb5a98f-327a-4214-8101-75ad2b5dc9e4" (UID: "bcb5a98f-327a-4214-8101-75ad2b5dc9e4"). InnerVolumeSpecName "kube-api-access-n5fzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:16:59.356520 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.356491 2575 generic.go:356] "Generic (PLEG): container finished" podID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" containerID="1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241" exitCode=0 Jun 05 14:16:59.356629 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.356541 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d4556fd7d-jljxr" Jun 05 14:16:59.356629 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.356575 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4556fd7d-jljxr" event={"ID":"bcb5a98f-327a-4214-8101-75ad2b5dc9e4","Type":"ContainerDied","Data":"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241"} Jun 05 14:16:59.356629 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.356627 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d4556fd7d-jljxr" event={"ID":"bcb5a98f-327a-4214-8101-75ad2b5dc9e4","Type":"ContainerDied","Data":"64713578a80bdef85a06f7aa5d23ba3b086d6f1d823122c11e69275c105d7c26"} Jun 05 14:16:59.356750 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.356655 2575 scope.go:117] "RemoveContainer" containerID="1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241" Jun 05 14:16:59.365388 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.365370 2575 scope.go:117] "RemoveContainer" containerID="1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241" Jun 05 14:16:59.365701 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:16:59.365678 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241\": container with ID starting with 1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241 not found: ID does not exist" containerID="1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241" Jun 05 14:16:59.365761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.365709 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241"} err="failed to get container status \"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241\": rpc error: code = NotFound desc = could not find container \"1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241\": container with ID starting with 1081136e5da44e4a0190d83a3de5b7f64ab5bb79e7c2068869a81ac3d0a4f241 not found: ID does not exist" Jun 05 14:16:59.378085 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.378052 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:59.383268 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.383183 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d4556fd7d-jljxr"] Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446509 2575 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-service-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446541 2575 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446550 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5fzn\" (UniqueName: \"kubernetes.io/projected/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-kube-api-access-n5fzn\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446559 2575 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-serving-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446569 2575 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-console-oauth-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446579 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-trusted-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:16:59.446593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:16:59.446587 2575 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bcb5a98f-327a-4214-8101-75ad2b5dc9e4-oauth-serving-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:00.126543 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:00.126514 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" path="/var/lib/kubelet/pods/bcb5a98f-327a-4214-8101-75ad2b5dc9e4/volumes" Jun 05 14:17:10.040688 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.040634 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:17:10.043137 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.043108 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f5bf7c05-0c41-4323-9d35-d5d1e416baea-metrics-certs\") pod \"network-metrics-daemon-2flc8\" (UID: \"f5bf7c05-0c41-4323-9d35-d5d1e416baea\") " pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:17:10.224792 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.224757 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-s2hcm\"" Jun 05 14:17:10.232959 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.232921 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2flc8" Jun 05 14:17:10.375761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.375727 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2flc8"] Jun 05 14:17:10.379560 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:17:10.379531 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5bf7c05_0c41_4323_9d35_d5d1e416baea.slice/crio-f18225915350d1ca3ccf0e261fcbe2084dd18a146dea44c8a86f882d5e0e2731 WatchSource:0}: Error finding container f18225915350d1ca3ccf0e261fcbe2084dd18a146dea44c8a86f882d5e0e2731: Status 404 returned error can't find the container with id f18225915350d1ca3ccf0e261fcbe2084dd18a146dea44c8a86f882d5e0e2731 Jun 05 14:17:10.402283 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:10.402249 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2flc8" event={"ID":"f5bf7c05-0c41-4323-9d35-d5d1e416baea","Type":"ContainerStarted","Data":"f18225915350d1ca3ccf0e261fcbe2084dd18a146dea44c8a86f882d5e0e2731"} Jun 05 14:17:11.407942 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:11.407842 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2flc8" event={"ID":"f5bf7c05-0c41-4323-9d35-d5d1e416baea","Type":"ContainerStarted","Data":"71ae470bc36141f0b9ea7b42f3d5a5e623bc25a4ee47f22e873e4d7693ac5b46"} Jun 05 14:17:11.407942 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:11.407905 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2flc8" event={"ID":"f5bf7c05-0c41-4323-9d35-d5d1e416baea","Type":"ContainerStarted","Data":"b911e0857be27a77b120501f0cd61e3840301bd1965153e4388ac471eea64258"} Jun 05 14:17:11.424594 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:11.424542 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2flc8" podStartSLOduration=374.663041821 podStartE2EDuration="6m15.424526132s" totalImagesPullingTime="761.484311ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:10:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:17:11.423112546 +0000 UTC m=+375.725895039" watchObservedRunningTime="2026-06-05 14:17:11.424526132 +0000 UTC m=+375.727308625" Jun 05 14:17:11.510690 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:11.510637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:11.566568 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:11.566512 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:13.394219 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:13.394172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:13.450144 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:13.450079 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:16.736406 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:16.736371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:16.754622 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:16.754588 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:17.449701 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:17.449670 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:22.123500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:22.123454 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:22.191769 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:22.191733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:26.302665 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:26.302624 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:26.402482 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:26.402442 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:27.125442 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:27.125405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:34.771337 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771297 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:34.771747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771620 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="prometheus" containerID="cri-o://f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be" gracePeriod=600 Jun 05 14:17:34.771747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771642 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy" containerID="cri-o://3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d" gracePeriod=600 Jun 05 14:17:34.771747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771663 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="config-reloader" containerID="cri-o://fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68" gracePeriod=600 Jun 05 14:17:34.771747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771689 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6" gracePeriod=600 Jun 05 14:17:34.771747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771695 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-web" containerID="cri-o://70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d" gracePeriod=600 Jun 05 14:17:34.772053 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.771649 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="thanos-sidecar" containerID="cri-o://9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b" gracePeriod=600 Jun 05 14:17:34.873382 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.873351 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:34.975333 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:34.975296 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:35.509452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509418 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6" exitCode=0 Jun 05 14:17:35.509452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509442 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d" exitCode=0 Jun 05 14:17:35.509452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509448 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b" exitCode=0 Jun 05 14:17:35.509452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509454 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68" exitCode=0 Jun 05 14:17:35.509452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509459 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be" exitCode=0 Jun 05 14:17:35.509731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509485 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6"} Jun 05 14:17:35.509731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509546 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d"} Jun 05 14:17:35.509731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509570 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b"} Jun 05 14:17:35.509731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68"} Jun 05 14:17:35.509731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:35.509618 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be"} Jun 05 14:17:36.007404 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.007379 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.056545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056512 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056561 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056592 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056628 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056653 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056696 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056684 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056708 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056739 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056776 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056805 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnd2z\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056830 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056862 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056894 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.056961 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.056921 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.057378 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057052 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.057378 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057283 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.057484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057420 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.057484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057469 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.057597 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057476 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.057597 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057527 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.057597 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057554 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.057737 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057593 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057886 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057935 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.057963 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out\") pod \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\" (UID: \"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e\") " Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058257 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058278 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058294 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058309 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.058588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058325 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.059107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.058851 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:17:36.059497 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.059259 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.060951 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.060913 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.062420 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.061954 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:17:36.062420 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.062353 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config" (OuterVolumeSpecName: "config") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.062774 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.062739 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:17:36.062879 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.062830 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z" (OuterVolumeSpecName: "kube-api-access-vnd2z") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "kube-api-access-vnd2z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:17:36.063072 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.063022 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out" (OuterVolumeSpecName: "config-out") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:17:36.063545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.063509 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.063645 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.063568 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.063645 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.063594 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.064190 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.064164 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.064816 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.064779 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.065041 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.065006 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.073027 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.073000 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config" (OuterVolumeSpecName: "web-config") pod "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" (UID: "fecd34f5-f979-4c98-a4c8-b8fe3560ce0e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:17:36.158929 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158899 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-web-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.158929 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158927 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-tls-assets\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158937 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-db\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158947 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158956 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158966 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnd2z\" (UniqueName: \"kubernetes.io/projected/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-kube-api-access-vnd2z\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158974 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-metrics-client-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158985 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-thanos-prometheus-http-client-file\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.158994 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-kube-rbac-proxy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159001 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-grpc-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159009 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-configmap-metrics-client-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159018 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159027 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159035 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.159084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.159043 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e-config-out\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:17:36.517238 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.517136 2575 generic.go:356] "Generic (PLEG): container finished" podID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerID="70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d" exitCode=0 Jun 05 14:17:36.517377 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.517231 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d"} Jun 05 14:17:36.517377 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.517261 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.517377 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.517303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fecd34f5-f979-4c98-a4c8-b8fe3560ce0e","Type":"ContainerDied","Data":"b74a73a5b01793660245be0af213a1f531ea90314ce226388814b6814c852e1c"} Jun 05 14:17:36.517377 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.517338 2575 scope.go:117] "RemoveContainer" containerID="e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6" Jun 05 14:17:36.525520 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.525504 2575 scope.go:117] "RemoveContainer" containerID="3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d" Jun 05 14:17:36.532554 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.532535 2575 scope.go:117] "RemoveContainer" containerID="70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d" Jun 05 14:17:36.537969 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.537944 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:36.540073 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.540057 2575 scope.go:117] "RemoveContainer" containerID="9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b" Jun 05 14:17:36.545342 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.545318 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:36.547260 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.547243 2575 scope.go:117] "RemoveContainer" containerID="fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68" Jun 05 14:17:36.554044 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.554028 2575 scope.go:117] "RemoveContainer" containerID="f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be" Jun 05 14:17:36.561256 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.561236 2575 scope.go:117] "RemoveContainer" containerID="a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476" Jun 05 14:17:36.567857 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.567842 2575 scope.go:117] "RemoveContainer" containerID="e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6" Jun 05 14:17:36.568117 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.568101 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6\": container with ID starting with e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6 not found: ID does not exist" containerID="e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6" Jun 05 14:17:36.568167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568127 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6"} err="failed to get container status \"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6\": rpc error: code = NotFound desc = could not find container \"e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6\": container with ID starting with e0ae433c667d11b90a1b884629c6410d04f14bc2174edd90ddc169e8a12206d6 not found: ID does not exist" Jun 05 14:17:36.568167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568143 2575 scope.go:117] "RemoveContainer" containerID="3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d" Jun 05 14:17:36.568414 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.568394 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d\": container with ID starting with 3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d not found: ID does not exist" containerID="3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d" Jun 05 14:17:36.568490 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568423 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d"} err="failed to get container status \"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d\": rpc error: code = NotFound desc = could not find container \"3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d\": container with ID starting with 3cfe717c41ecedadad2dc7cdb0b03b2c3389fab4696b8fc89238783618f0110d not found: ID does not exist" Jun 05 14:17:36.568490 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568446 2575 scope.go:117] "RemoveContainer" containerID="70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d" Jun 05 14:17:36.568686 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.568671 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d\": container with ID starting with 70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d not found: ID does not exist" containerID="70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d" Jun 05 14:17:36.568755 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568695 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d"} err="failed to get container status \"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d\": rpc error: code = NotFound desc = could not find container \"70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d\": container with ID starting with 70c7176f84a9af43ac9b47a18fe03b52fb27954d27887b971e4c1233fedc6d0d not found: ID does not exist" Jun 05 14:17:36.568755 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568713 2575 scope.go:117] "RemoveContainer" containerID="9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b" Jun 05 14:17:36.568927 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.568912 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b\": container with ID starting with 9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b not found: ID does not exist" containerID="9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b" Jun 05 14:17:36.568989 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568933 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b"} err="failed to get container status \"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b\": rpc error: code = NotFound desc = could not find container \"9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b\": container with ID starting with 9a8c464ef3a6ba39b96c1ee6a7e0b20dcc157a78965cb02fe59a5b4818be206b not found: ID does not exist" Jun 05 14:17:36.568989 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.568969 2575 scope.go:117] "RemoveContainer" containerID="fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68" Jun 05 14:17:36.569228 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.569188 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68\": container with ID starting with fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68 not found: ID does not exist" containerID="fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68" Jun 05 14:17:36.569277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.569235 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68"} err="failed to get container status \"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68\": rpc error: code = NotFound desc = could not find container \"fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68\": container with ID starting with fa9bbfeba58f0df7ec704693f0d3d2349b127936c4e597884fee2a2f397d5b68 not found: ID does not exist" Jun 05 14:17:36.569277 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.569250 2575 scope.go:117] "RemoveContainer" containerID="f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be" Jun 05 14:17:36.569456 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.569441 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be\": container with ID starting with f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be not found: ID does not exist" containerID="f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be" Jun 05 14:17:36.569499 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.569457 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be"} err="failed to get container status \"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be\": rpc error: code = NotFound desc = could not find container \"f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be\": container with ID starting with f330799d49bf7f029ea566353b554f174a6cd02c18f68fcf1bb7e2ec5eb735be not found: ID does not exist" Jun 05 14:17:36.569499 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.569469 2575 scope.go:117] "RemoveContainer" containerID="a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476" Jun 05 14:17:36.569692 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:17:36.569674 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476\": container with ID starting with a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476 not found: ID does not exist" containerID="a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476" Jun 05 14:17:36.569745 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.569699 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476"} err="failed to get container status \"a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476\": rpc error: code = NotFound desc = could not find container \"a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476\": container with ID starting with a1eaf242fa5d6d2cdca0e58608cce18016c37934eda3f6308ec7a85b19b31476 not found: ID does not exist" Jun 05 14:17:36.573851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.573831 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:36.574098 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574086 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="074af4a4-705c-4771-a709-a4042e91335d" containerName="registry" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574101 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="074af4a4-705c-4771-a709-a4042e91335d" containerName="registry" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574115 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-thanos" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574120 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-thanos" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574129 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="thanos-sidecar" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574134 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="thanos-sidecar" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574141 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="prometheus" Jun 05 14:17:36.574147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574146 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="prometheus" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574153 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="config-reloader" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574158 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="config-reloader" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574165 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="init-config-reloader" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574170 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="init-config-reloader" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574177 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-web" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574181 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-web" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574190 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" containerName="console" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574212 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" containerName="console" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574223 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574228 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574271 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="074af4a4-705c-4771-a709-a4042e91335d" containerName="registry" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574279 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="config-reloader" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574284 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574290 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-web" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574296 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="prometheus" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574301 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcb5a98f-327a-4214-8101-75ad2b5dc9e4" containerName="console" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574306 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="thanos-sidecar" Jun 05 14:17:36.574417 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.574310 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" containerName="kube-rbac-proxy-thanos" Jun 05 14:17:36.577950 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.577935 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.580646 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580612 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 14:17:36.580646 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 14:17:36.580876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580616 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 14:17:36.580983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580900 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 14:17:36.580983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580934 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2z4vm\"" Jun 05 14:17:36.581108 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.580940 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 14:17:36.581108 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.581016 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 14:17:36.582016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.581955 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 14:17:36.582016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.581963 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-29hsou4pfef2u\"" Jun 05 14:17:36.582016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.582008 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 14:17:36.582346 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.582004 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 14:17:36.582346 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.581969 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 14:17:36.582346 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.582101 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 14:17:36.582538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.582502 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 14:17:36.582538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.582520 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 14:17:36.584410 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.584391 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 14:17:36.586816 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.586798 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 14:17:36.592565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.592542 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:36.662729 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662729 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662724 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-web-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662857 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662898 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.662926 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662922 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662940 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.662974 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-config-out\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663110 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663168 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663193 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663254 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.663279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.663269 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfrvw\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-kube-api-access-hfrvw\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764188 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764139 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764188 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764192 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764487 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764467 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764552 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764517 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764609 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764609 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764580 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764705 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfrvw\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-kube-api-access-hfrvw\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764705 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764705 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764668 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-web-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764704 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764739 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764773 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.764851 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764868 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764896 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.764991 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-config-out\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765088 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.765014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.765563 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.765579 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.765890 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.765862 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.767356 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.767289 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.767456 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.767374 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.767456 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.767393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.767573 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.767562 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768034 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768536 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768536 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768495 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768686 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768617 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768787 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768764 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-web-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.768846 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.768821 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.769035 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.769016 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.769107 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.769089 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22070c39-d194-4405-9061-814c019c8110-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.769786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.769771 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-config\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.770193 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.770177 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.770637 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.770609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22070c39-d194-4405-9061-814c019c8110-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.770778 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.770760 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22070c39-d194-4405-9061-814c019c8110-config-out\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.776441 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.776423 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfrvw\" (UniqueName: \"kubernetes.io/projected/22070c39-d194-4405-9061-814c019c8110-kube-api-access-hfrvw\") pod \"prometheus-k8s-0\" (UID: \"22070c39-d194-4405-9061-814c019c8110\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:36.888213 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:36.888164 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:37.024638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:37.024566 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 14:17:37.027679 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:17:37.027639 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22070c39_d194_4405_9061_814c019c8110.slice/crio-68b7976cca02c720f91939be5998c92ac5df490d099f4114ce3c09f6bc8c9ffc WatchSource:0}: Error finding container 68b7976cca02c720f91939be5998c92ac5df490d099f4114ce3c09f6bc8c9ffc: Status 404 returned error can't find the container with id 68b7976cca02c720f91939be5998c92ac5df490d099f4114ce3c09f6bc8c9ffc Jun 05 14:17:37.523536 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:37.523498 2575 generic.go:356] "Generic (PLEG): container finished" podID="22070c39-d194-4405-9061-814c019c8110" containerID="8ead4a160f61d76de2e79f41c3d15590647dd59795d5614808806a0b26fd8d78" exitCode=0 Jun 05 14:17:37.523536 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:37.523540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerDied","Data":"8ead4a160f61d76de2e79f41c3d15590647dd59795d5614808806a0b26fd8d78"} Jun 05 14:17:37.523786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:37.523602 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"68b7976cca02c720f91939be5998c92ac5df490d099f4114ce3c09f6bc8c9ffc"} Jun 05 14:17:38.075068 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.075031 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:38.128427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.128388 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:38.130021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.129994 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecd34f5-f979-4c98-a4c8-b8fe3560ce0e" path="/var/lib/kubelet/pods/fecd34f5-f979-4c98-a4c8-b8fe3560ce0e/volumes" Jun 05 14:17:38.530837 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.530802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"fdef97f0d304898b3a3239daf5466ef11645c64f2e6d14be93f7de897a96e262"} Jun 05 14:17:38.530980 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.530881 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"b7ea7839744a642ea91265f9843122d7ebbb250807bc5f5f8628ec42b0e32b2a"} Jun 05 14:17:38.530980 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.530919 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"542770cfc02110db7f28ecfa0d9839e32a08eb1c5ce809c51bad7827a4dc95b4"} Jun 05 14:17:38.530980 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.530960 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"a14022d9cf04544c5fbf2197c83632cf0aa321a00263c903739eb19b2ea98501"} Jun 05 14:17:38.531097 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.530999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"f48c92af80f16ea2cad4291e824b536fbe737327260a54a8a8f2e0e8fb4bf63d"} Jun 05 14:17:38.531097 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.531036 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22070c39-d194-4405-9061-814c019c8110","Type":"ContainerStarted","Data":"8543c76039eac2690ca5e63474e4f21c5c6a0cfb8331cde6a6a93082ab4aaf73"} Jun 05 14:17:38.559459 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:38.559407 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.540244289 podStartE2EDuration="2.559392179s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.14789ms" isStatefulPod=false podCreationTimestamp="2026-06-05 14:17:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:17:38.557329474 +0000 UTC m=+402.860111979" watchObservedRunningTime="2026-06-05 14:17:38.559392179 +0000 UTC m=+402.862174672" Jun 05 14:17:41.888932 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:41.888876 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:17:46.262802 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:46.262766 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:46.364971 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:46.364928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:46.419068 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:46.419037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:46.846318 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:46.846278 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:46.943214 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:46.943164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:17:47.163271 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:17:47.163166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:18:33.033457 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:18:33.033405 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:18:33.089470 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:18:33.089435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:18:36.889109 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:18:36.889060 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:18:36.904324 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:18:36.904300 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:18:37.786233 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:18:37.786135 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 14:19:36.888248 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:19:36.888190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:01.906521 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:01.906436 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:06.861788 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:06.861748 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:06.916956 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:06.916923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:23.237286 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:23.237247 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:24.273402 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:24.273366 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:24.374159 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:24.374122 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:34.343341 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:34.343308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:20:56.104550 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:56.104506 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:20:56.110640 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:56.110614 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:20:56.118842 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:56.118820 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:20:56.119506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:20:56.119484 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:21:11.026800 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:11.026702 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:12.194859 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:12.194802 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:13.182100 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:13.182053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:13.231280 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:13.231246 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:40.401970 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:40.401934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:40.499382 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:40.499349 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:40.600533 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:40.600499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:41.142129 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:41.142095 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:41.192938 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:41.192907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:51.118206 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:51.118166 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:51.212351 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:51.212317 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:21:51.277636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:21:51.277585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:24:00.175025 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:24:00.174984 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:25:56.136090 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:25:56.136011 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:25:56.136694 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:25:56.136395 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:25:56.146287 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:25:56.146270 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:25:56.146754 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:25:56.146734 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:30:56.161659 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:30:56.161632 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:30:56.163990 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:30:56.163968 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:30:56.173066 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:30:56.173047 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:30:56.175194 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:30:56.175175 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:31:42.426756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:31:42.426661 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:31:54.388975 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:31:54.388932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:31:54.487106 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:31:54.487075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:04.204469 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:04.204429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:15.892671 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:15.892630 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:16.692296 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:16.692250 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:19.490091 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:19.490056 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:19.590133 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:19.590097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:22.263994 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:22.263950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:22.367746 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:22.367714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:22.569000 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:22.568966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:22.680346 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:22.680307 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:25.564397 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:25.564367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:26.145839 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:26.145744 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:26.294434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:26.294389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:26.394787 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:26.394756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:31.223972 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:31.223930 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:33.788891 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:33.788858 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:33.873135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:33.873097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:33.973355 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:33.973318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:41.138650 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:41.138614 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:41.240298 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:41.240256 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:43.355583 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:43.355549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:56.521904 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:56.521872 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:56.614434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:56.614377 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.137435 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.137401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.330834 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.330804 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.429154 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.429068 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.467272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.467237 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9"] Jun 05 14:32:57.470600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.470581 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.473434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.473406 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 05 14:32:57.473434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.473427 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q8s6m\"" Jun 05 14:32:57.473624 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.473491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 05 14:32:57.474503 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.474484 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 14:32:57.474503 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.474500 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 14:32:57.487517 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.487491 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9"] Jun 05 14:32:57.554698 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.554666 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n5vt\" (UniqueName: \"kubernetes.io/projected/d7d18f7a-a830-463c-91bc-52b34c76c08d-kube-api-access-7n5vt\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.555135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.554723 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-webhook-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.555135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.554742 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.555135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.554823 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-manifests\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.555135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.554886 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-tmp\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.642079 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.642038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.656209 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656177 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-webhook-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.656372 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656231 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.656372 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656258 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-manifests\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.656372 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-tmp\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.656372 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656314 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n5vt\" (UniqueName: \"kubernetes.io/projected/d7d18f7a-a830-463c-91bc-52b34c76c08d-kube-api-access-7n5vt\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.656779 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.656750 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-manifests\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.658624 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.658600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d7d18f7a-a830-463c-91bc-52b34c76c08d-tmp\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.658710 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.658679 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-webhook-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.658761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.658747 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d7d18f7a-a830-463c-91bc-52b34c76c08d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.666325 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.666302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n5vt\" (UniqueName: \"kubernetes.io/projected/d7d18f7a-a830-463c-91bc-52b34c76c08d-kube-api-access-7n5vt\") pod \"opendatahub-operator-controller-manager-649f7d5648-xm9v9\" (UID: \"d7d18f7a-a830-463c-91bc-52b34c76c08d\") " pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.739342 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.739257 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.781973 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.781945 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:32:57.840720 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.840658 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.895142 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.895111 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:57.916814 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.916787 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9"] Jun 05 14:32:57.919631 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:32:57.919567 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7d18f7a_a830_463c_91bc_52b34c76c08d.slice/crio-75259fe920209b7b10c6a740c638722cf5c079f9178d9d5cfaf5060eff204361 WatchSource:0}: Error finding container 75259fe920209b7b10c6a740c638722cf5c079f9178d9d5cfaf5060eff204361: Status 404 returned error can't find the container with id 75259fe920209b7b10c6a740c638722cf5c079f9178d9d5cfaf5060eff204361 Jun 05 14:32:57.921418 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:57.921397 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:32:58.153381 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:58.153347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" event={"ID":"d7d18f7a-a830-463c-91bc-52b34c76c08d","Type":"ContainerStarted","Data":"75259fe920209b7b10c6a740c638722cf5c079f9178d9d5cfaf5060eff204361"} Jun 05 14:32:58.224676 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:58.224636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:32:58.325212 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:32:58.325156 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:01.170343 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:01.170304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" event={"ID":"d7d18f7a-a830-463c-91bc-52b34c76c08d","Type":"ContainerStarted","Data":"5d1773154fd45fadf1f2280de0776237b9319a73f928b70c0c0659cb6614f8ad"} Jun 05 14:33:02.176178 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:02.176138 2575 generic.go:356] "Generic (PLEG): container finished" podID="d7d18f7a-a830-463c-91bc-52b34c76c08d" containerID="5d1773154fd45fadf1f2280de0776237b9319a73f928b70c0c0659cb6614f8ad" exitCode=0 Jun 05 14:33:02.176582 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:02.176223 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" event={"ID":"d7d18f7a-a830-463c-91bc-52b34c76c08d","Type":"ContainerDied","Data":"5d1773154fd45fadf1f2280de0776237b9319a73f928b70c0c0659cb6614f8ad"} Jun 05 14:33:03.182793 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:03.182752 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" event={"ID":"d7d18f7a-a830-463c-91bc-52b34c76c08d","Type":"ContainerStarted","Data":"3f9fdb65accdb253147ed23703ed87c5118bcda778abdf2822fd553377d04331"} Jun 05 14:33:03.183305 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:03.182878 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:33:03.205272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:03.205221 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" podStartSLOduration=2.104077009 podStartE2EDuration="6.20518983s" totalImagesPullingTime="3.102968549s" totalInitContainerRuntime="998.144272ms" isStatefulPod=false podCreationTimestamp="2026-06-05 14:32:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:33:03.203956813 +0000 UTC m=+1327.506739306" watchObservedRunningTime="2026-06-05 14:33:03.20518983 +0000 UTC m=+1327.507972323" Jun 05 14:33:09.137125 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:09.137081 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:09.230635 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:09.230597 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:09.340620 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:09.340542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:09.451308 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:09.451218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:14.188983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:14.188947 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-649f7d5648-xm9v9" Jun 05 14:33:16.213290 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.213253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:16.320037 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.319992 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:16.423361 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.423306 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:16.511899 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.511810 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:16.585857 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.585811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:16.898018 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:16.897975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:17.006081 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:17.006046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:17.110869 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:17.110835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:17.318811 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:17.318772 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:17.534795 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:17.534756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:17.936263 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:17.936232 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:25.301905 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.300162 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws"] Jun 05 14:33:25.308693 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.308666 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.315983 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.315959 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 05 14:33:25.317655 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.317628 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 05 14:33:25.317759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.317653 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 05 14:33:25.317759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.317682 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-snlxq\"" Jun 05 14:33:25.317759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.317751 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 05 14:33:25.317986 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.317962 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 05 14:33:25.328673 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.328619 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws"] Jun 05 14:33:25.396639 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.396602 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.396829 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.396680 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-882xt\" (UniqueName: \"kubernetes.io/projected/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-kube-api-access-882xt\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.396829 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.396703 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-manager-config\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.396829 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.396719 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-metrics-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.497933 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.497889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.498132 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.497958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-882xt\" (UniqueName: \"kubernetes.io/projected/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-kube-api-access-882xt\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.498132 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.497989 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-manager-config\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.498132 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.498039 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-metrics-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.498744 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.498718 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-manager-config\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.500471 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.500440 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.500637 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.500613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-metrics-cert\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.513440 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.513415 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-882xt\" (UniqueName: \"kubernetes.io/projected/27dadcf1-59b2-4a8c-a9bc-d844886cc2c7-kube-api-access-882xt\") pod \"lws-controller-manager-856cfbf6b6-nk4ws\" (UID: \"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7\") " pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.618142 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.618111 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:25.619165 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.619132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:25.712101 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.711962 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:25.781954 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.781928 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws"] Jun 05 14:33:25.784637 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:33:25.784608 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27dadcf1_59b2_4a8c_a9bc_d844886cc2c7.slice/crio-eb490665bbce395ffd8d10431e775948314be2e3d8e945827ace9eeb10988e78 WatchSource:0}: Error finding container eb490665bbce395ffd8d10431e775948314be2e3d8e945827ace9eeb10988e78: Status 404 returned error can't find the container with id eb490665bbce395ffd8d10431e775948314be2e3d8e945827ace9eeb10988e78 Jun 05 14:33:25.807616 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.807579 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:25.918184 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:25.918071 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:26.027525 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:26.027487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:26.118894 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:26.118857 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:26.283505 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:26.283427 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" event={"ID":"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7","Type":"ContainerStarted","Data":"eb490665bbce395ffd8d10431e775948314be2e3d8e945827ace9eeb10988e78"} Jun 05 14:33:29.300363 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:29.300327 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" event={"ID":"27dadcf1-59b2-4a8c-a9bc-d844886cc2c7","Type":"ContainerStarted","Data":"0a2a0a8c3ffd5390986b16f75d7a1b233021dc9bf9868e539a4f876909ddd549"} Jun 05 14:33:29.300790 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:29.300447 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:29.325858 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:29.325809 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" podStartSLOduration=1.52890657 podStartE2EDuration="4.325792161s" totalImagesPullingTime="2.796885591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:33:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:33:29.323971994 +0000 UTC m=+1353.626754497" watchObservedRunningTime="2026-06-05 14:33:29.325792161 +0000 UTC m=+1353.628574654" Jun 05 14:33:33.627217 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:33.627147 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:33.727544 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:33.727510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:34.656925 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:34.656887 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:34.753990 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:34.753921 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:35.356772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:35.356727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:35.458508 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:35.458445 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:36.061552 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:36.061504 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:40.307332 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:40.307298 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-856cfbf6b6-nk4ws" Jun 05 14:33:45.829156 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:45.829113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:45.929106 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:45.929041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:46.328526 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:46.328483 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:46.432999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:46.432947 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:46.532877 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:46.532835 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:49.339042 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.339004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:49.439425 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.439389 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:49.597186 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.597111 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:33:49.600541 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.600521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.603154 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.603134 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-q4pmq\"" Jun 05 14:33:49.603154 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.603140 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 05 14:33:49.605231 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605354 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605354 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605279 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605354 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4pts\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605452 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605402 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605558 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605558 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605728 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605563 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.605728 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.605606 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.610993 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.610971 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:33:49.625401 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.625371 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:49.705950 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.705915 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.705950 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.705952 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.705980 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706018 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4pts\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706049 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706087 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706182 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706131 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706499 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706448 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706557 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706493 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706557 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706511 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706671 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706570 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706671 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706764 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706674 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.706975 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.706953 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.708615 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.708593 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.708733 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.708711 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.713620 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.713598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4pts\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.713707 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.713622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.798697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.798655 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:49.809827 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.809800 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r"] Jun 05 14:33:49.814147 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.814129 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.826295 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.826272 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r"] Jun 05 14:33:49.907997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.907916 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.907997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.907956 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908022 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908082 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908106 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908125 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908171 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908371 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908228 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.908371 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.908252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwjrm\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-kube-api-access-nwjrm\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:49.912680 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.912659 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:49.943668 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:49.943635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:50.008789 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.008936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008844 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.008936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.008936 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008907 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008950 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.008972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwjrm\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-kube-api-access-nwjrm\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009051 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009102 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009093 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009387 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009168 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009743 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009454 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009743 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009560 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009743 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009706 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.009947 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.009871 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.011364 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.011338 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.012646 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.012622 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.017093 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.017064 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.017907 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.017876 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwjrm\" (UniqueName: \"kubernetes.io/projected/c49182eb-4247-4afc-ac96-5e5a0cc5069d-kube-api-access-nwjrm\") pod \"data-science-gateway-data-science-gateway-class-74759f9795qvd8r\" (UID: \"c49182eb-4247-4afc-ac96-5e5a0cc5069d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.053957 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.053929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:33:50.055764 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:33:50.055737 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33a9ee71_addd_4e6d_91b8_af1d5a7bb8ba.slice/crio-29dff84c642e605c437cd0093b8fd95225c50a19d3accb3a7d09fc4f019886d7 WatchSource:0}: Error finding container 29dff84c642e605c437cd0093b8fd95225c50a19d3accb3a7d09fc4f019886d7: Status 404 returned error can't find the container with id 29dff84c642e605c437cd0093b8fd95225c50a19d3accb3a7d09fc4f019886d7 Jun 05 14:33:50.125978 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.125950 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:50.257628 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.257597 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r"] Jun 05 14:33:50.260496 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:33:50.260472 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49182eb_4247_4afc_ac96_5e5a0cc5069d.slice/crio-eac5da004dec8e8d893229b63e1d91e16764421266aca995647d665222d5d2f4 WatchSource:0}: Error finding container eac5da004dec8e8d893229b63e1d91e16764421266aca995647d665222d5d2f4: Status 404 returned error can't find the container with id eac5da004dec8e8d893229b63e1d91e16764421266aca995647d665222d5d2f4 Jun 05 14:33:50.400284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.400245 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" event={"ID":"c49182eb-4247-4afc-ac96-5e5a0cc5069d","Type":"ContainerStarted","Data":"eac5da004dec8e8d893229b63e1d91e16764421266aca995647d665222d5d2f4"} Jun 05 14:33:50.401401 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:50.401377 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" event={"ID":"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba","Type":"ContainerStarted","Data":"29dff84c642e605c437cd0093b8fd95225c50a19d3accb3a7d09fc4f019886d7"} Jun 05 14:33:53.070060 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.070017 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.070451 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.070091 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.070451 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.070121 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.076359 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.076326 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.076431 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.076412 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.076474 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.076457 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:33:53.419930 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.419891 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" event={"ID":"c49182eb-4247-4afc-ac96-5e5a0cc5069d","Type":"ContainerStarted","Data":"0826599e9c084ad3a86884161c2856bcfd55d389744243b9c52db905f333f38c"} Jun 05 14:33:53.421599 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.421572 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" event={"ID":"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba","Type":"ContainerStarted","Data":"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8"} Jun 05 14:33:53.450267 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.450188 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" podStartSLOduration=1.63664766 podStartE2EDuration="4.450168445s" totalImagesPullingTime="2.813520785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:33:53.440105866 +0000 UTC m=+1377.742888355" watchObservedRunningTime="2026-06-05 14:33:53.450168445 +0000 UTC m=+1377.752950935" Jun 05 14:33:53.460785 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.460733 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" podStartSLOduration=1.44873835 podStartE2EDuration="4.460721303s" totalImagesPullingTime="3.011982953s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:33:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:33:53.459571368 +0000 UTC m=+1377.762353861" watchObservedRunningTime="2026-06-05 14:33:53.460721303 +0000 UTC m=+1377.763503789" Jun 05 14:33:53.800848 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.800760 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-77985dbbcc-x7wt9"] Jun 05 14:33:53.804991 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.804965 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.808174 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.808147 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 05 14:33:53.808523 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.808274 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-7hzsz\"" Jun 05 14:33:53.811922 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.811895 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-77985dbbcc-x7wt9"] Jun 05 14:33:53.829984 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.829953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:33:53.846108 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.846077 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkwqh\" (UniqueName: \"kubernetes.io/projected/f915661d-4819-4817-9a19-3bc5c964baf8-kube-api-access-xkwqh\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.846278 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.846142 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f915661d-4819-4817-9a19-3bc5c964baf8-redirect-config\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.913072 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.913034 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:33:53.947633 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.947603 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkwqh\" (UniqueName: \"kubernetes.io/projected/f915661d-4819-4817-9a19-3bc5c964baf8-kube-api-access-xkwqh\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.947800 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.947641 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f915661d-4819-4817-9a19-3bc5c964baf8-redirect-config\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.948391 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.948370 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/f915661d-4819-4817-9a19-3bc5c964baf8-redirect-config\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:53.955344 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:53.955321 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkwqh\" (UniqueName: \"kubernetes.io/projected/f915661d-4819-4817-9a19-3bc5c964baf8-kube-api-access-xkwqh\") pod \"dashboard-redirect-77985dbbcc-x7wt9\" (UID: \"f915661d-4819-4817-9a19-3bc5c964baf8\") " pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:54.118478 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.118451 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" Jun 05 14:33:54.127741 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.127718 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:54.131996 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.131975 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:54.247043 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.246955 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-77985dbbcc-x7wt9"] Jun 05 14:33:54.249298 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:33:54.249269 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf915661d_4819_4817_9a19_3bc5c964baf8.slice/crio-6f74231b3037c67e0edb6260c628bf69c3adee295767ed39ec3c1b6b46c900b9 WatchSource:0}: Error finding container 6f74231b3037c67e0edb6260c628bf69c3adee295767ed39ec3c1b6b46c900b9: Status 404 returned error can't find the container with id 6f74231b3037c67e0edb6260c628bf69c3adee295767ed39ec3c1b6b46c900b9 Jun 05 14:33:54.428596 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.428500 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" event={"ID":"f915661d-4819-4817-9a19-3bc5c964baf8","Type":"ContainerStarted","Data":"6f74231b3037c67e0edb6260c628bf69c3adee295767ed39ec3c1b6b46c900b9"} Jun 05 14:33:54.428921 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.428900 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:54.429874 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.429850 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795qvd8r" Jun 05 14:33:54.474471 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.474432 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:33:54.914518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.914482 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 05 14:33:54.914666 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:54.914540 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 05 14:33:55.913692 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:55.913655 2575 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" start-of-body= Jun 05 14:33:55.914128 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:55.913711 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.28:15021/healthz/ready\": dial tcp 10.132.0.28:15021: connect: connection refused" Jun 05 14:33:56.439786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:56.439743 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" event={"ID":"f915661d-4819-4817-9a19-3bc5c964baf8","Type":"ContainerStarted","Data":"577e322ac2971b39b0185da8ee088affc6019d995717372261964b615766490e"} Jun 05 14:33:56.440031 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:56.440008 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" containerID="cri-o://7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8" gracePeriod=30 Jun 05 14:33:56.456638 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:33:56.456587 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-77985dbbcc-x7wt9" podStartSLOduration=1.47941386 podStartE2EDuration="3.456573594s" totalImagesPullingTime="1.977159734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:33:56.456093785 +0000 UTC m=+1380.758876280" watchObservedRunningTime="2026-06-05 14:33:56.456573594 +0000 UTC m=+1380.759356122" Jun 05 14:34:01.699492 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.699426 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:34:01.816976 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.816935 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817149 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817149 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817065 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817149 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817092 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817149 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817142 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817167 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817214 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817244 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817299 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4pts\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts\") pod \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\" (UID: \"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba\") " Jun 05 14:34:01.817350 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817335 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:34:01.817600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817350 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:34:01.817600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817496 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:34:01.817600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817504 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data" (OuterVolumeSpecName: "istio-data") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:34:01.817756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817604 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-credential-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.817756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817621 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.817756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817634 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istiod-ca-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.817756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817647 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-data\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.817756 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.817722 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:34:01.819338 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.819302 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 14:34:01.819595 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.819574 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token" (OuterVolumeSpecName: "istio-token") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:34:01.819812 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.819794 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts" (OuterVolumeSpecName: "kube-api-access-m4pts") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "kube-api-access-m4pts". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:34:01.819812 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.819799 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" (UID: "33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 14:34:01.918218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.918163 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-workload-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.918218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.918189 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-podinfo\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.918218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.918220 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-token\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.918427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.918229 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4pts\" (UniqueName: \"kubernetes.io/projected/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-kube-api-access-m4pts\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:01.918427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:01.918239 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba-istio-envoy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:02.467175 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.467081 2575 generic.go:356] "Generic (PLEG): container finished" podID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerID="7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8" exitCode=0 Jun 05 14:34:02.467175 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.467123 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" Jun 05 14:34:02.467433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.467122 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" event={"ID":"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba","Type":"ContainerDied","Data":"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8"} Jun 05 14:34:02.467433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.467257 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79" event={"ID":"33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba","Type":"ContainerDied","Data":"29dff84c642e605c437cd0093b8fd95225c50a19d3accb3a7d09fc4f019886d7"} Jun 05 14:34:02.467433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.467290 2575 scope.go:117] "RemoveContainer" containerID="7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8" Jun 05 14:34:02.476048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.476032 2575 scope.go:117] "RemoveContainer" containerID="7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8" Jun 05 14:34:02.476363 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:34:02.476343 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8\": container with ID starting with 7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8 not found: ID does not exist" containerID="7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8" Jun 05 14:34:02.476434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.476372 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8"} err="failed to get container status \"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8\": rpc error: code = NotFound desc = could not find container \"7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8\": container with ID starting with 7ce47dff4a6afe1ddfb30dd1e44cf4956ae179a8284df277bbcd9ca8464f50e8 not found: ID does not exist" Jun 05 14:34:02.485183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.485158 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:34:02.488515 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:02.488496 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5df4d9ff6fhsv79"] Jun 05 14:34:04.127062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:04.127030 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" path="/var/lib/kubelet/pods/33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba/volumes" Jun 05 14:34:17.752943 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.752899 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:17.850580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.850544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:17.880076 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.880039 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:17.880453 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.880438 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" Jun 05 14:34:17.880506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.880456 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" Jun 05 14:34:17.880542 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.880521 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="33a9ee71-addd-4e6d-91b8-af1d5a7bb8ba" containerName="istio-proxy" Jun 05 14:34:17.883527 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.883505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:17.886191 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.886165 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 05 14:34:17.886335 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.886259 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 05 14:34:17.887406 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.887389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-75n8s\"" Jun 05 14:34:17.892511 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.891940 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:17.947524 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.947488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:17.959797 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:17.959767 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxwzf\" (UniqueName: \"kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf\") pod \"kuadrant-operator-catalog-b9hzm\" (UID: \"d3ef617e-be2b-4489-b1f9-c1a172b9a348\") " pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:18.060977 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.060878 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxwzf\" (UniqueName: \"kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf\") pod \"kuadrant-operator-catalog-b9hzm\" (UID: \"d3ef617e-be2b-4489-b1f9-c1a172b9a348\") " pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:18.068673 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.068639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxwzf\" (UniqueName: \"kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf\") pod \"kuadrant-operator-catalog-b9hzm\" (UID: \"d3ef617e-be2b-4489-b1f9-c1a172b9a348\") " pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:18.195997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.195963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:18.248868 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.248842 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:18.331731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.331701 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:18.334126 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:34:18.334098 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ef617e_be2b_4489_b1f9_c1a172b9a348.slice/crio-38f7765f3b95f9f353a6118fb8734911b82fefc93bcb77353001397c7ad17d6c WatchSource:0}: Error finding container 38f7765f3b95f9f353a6118fb8734911b82fefc93bcb77353001397c7ad17d6c: Status 404 returned error can't find the container with id 38f7765f3b95f9f353a6118fb8734911b82fefc93bcb77353001397c7ad17d6c Jun 05 14:34:18.457293 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.457235 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sw5bd"] Jun 05 14:34:18.461786 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.461765 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:18.468211 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.468149 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sw5bd"] Jun 05 14:34:18.540444 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.540405 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" event={"ID":"d3ef617e-be2b-4489-b1f9-c1a172b9a348","Type":"ContainerStarted","Data":"38f7765f3b95f9f353a6118fb8734911b82fefc93bcb77353001397c7ad17d6c"} Jun 05 14:34:18.565955 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.565914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqc9s\" (UniqueName: \"kubernetes.io/projected/124a126d-08f4-4a6b-878f-b83980ae5797-kube-api-access-cqc9s\") pod \"kuadrant-operator-catalog-sw5bd\" (UID: \"124a126d-08f4-4a6b-878f-b83980ae5797\") " pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:18.666502 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.666421 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqc9s\" (UniqueName: \"kubernetes.io/projected/124a126d-08f4-4a6b-878f-b83980ae5797-kube-api-access-cqc9s\") pod \"kuadrant-operator-catalog-sw5bd\" (UID: \"124a126d-08f4-4a6b-878f-b83980ae5797\") " pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:18.674822 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.674798 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqc9s\" (UniqueName: \"kubernetes.io/projected/124a126d-08f4-4a6b-878f-b83980ae5797-kube-api-access-cqc9s\") pod \"kuadrant-operator-catalog-sw5bd\" (UID: \"124a126d-08f4-4a6b-878f-b83980ae5797\") " pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:18.680386 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.680348 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:18.772720 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.772690 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:18.883861 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.883729 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:18.913993 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:18.913918 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sw5bd"] Jun 05 14:34:18.946616 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:34:18.946546 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod124a126d_08f4_4a6b_878f_b83980ae5797.slice/crio-be47ca4e3aec2ca6e27f1be42031f4945d915cd0005a4109b28ed5527830154e WatchSource:0}: Error finding container be47ca4e3aec2ca6e27f1be42031f4945d915cd0005a4109b28ed5527830154e: Status 404 returned error can't find the container with id be47ca4e3aec2ca6e27f1be42031f4945d915cd0005a4109b28ed5527830154e Jun 05 14:34:19.548913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:19.548877 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" event={"ID":"124a126d-08f4-4a6b-878f-b83980ae5797","Type":"ContainerStarted","Data":"be47ca4e3aec2ca6e27f1be42031f4945d915cd0005a4109b28ed5527830154e"} Jun 05 14:34:20.556389 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.556346 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" event={"ID":"d3ef617e-be2b-4489-b1f9-c1a172b9a348","Type":"ContainerStarted","Data":"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53"} Jun 05 14:34:20.556870 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.556384 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" podUID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" containerName="registry-server" containerID="cri-o://aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53" gracePeriod=2 Jun 05 14:34:20.558747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.558334 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" event={"ID":"124a126d-08f4-4a6b-878f-b83980ae5797","Type":"ContainerStarted","Data":"5e6dc769486f5e0b4821a1ba49f1e99025b615adf464cdd8812d9eb24556efbf"} Jun 05 14:34:20.570799 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.570752 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" podStartSLOduration=1.484437406 podStartE2EDuration="3.570735548s" totalImagesPullingTime="2.086298142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:34:20.569960717 +0000 UTC m=+1404.872743211" watchObservedRunningTime="2026-06-05 14:34:20.570735548 +0000 UTC m=+1404.873518040" Jun 05 14:34:20.584778 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.584724 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" podStartSLOduration=1.10823965 podStartE2EDuration="2.584707249s" totalImagesPullingTime="1.476467599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:34:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:34:20.582922757 +0000 UTC m=+1404.885705251" watchObservedRunningTime="2026-06-05 14:34:20.584707249 +0000 UTC m=+1404.887489741" Jun 05 14:34:20.908255 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.908230 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:20.987690 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.987593 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sxwzf\" (UniqueName: \"kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf\") pod \"d3ef617e-be2b-4489-b1f9-c1a172b9a348\" (UID: \"d3ef617e-be2b-4489-b1f9-c1a172b9a348\") " Jun 05 14:34:20.989724 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:20.989693 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf" (OuterVolumeSpecName: "kube-api-access-sxwzf") pod "d3ef617e-be2b-4489-b1f9-c1a172b9a348" (UID: "d3ef617e-be2b-4489-b1f9-c1a172b9a348"). InnerVolumeSpecName "kube-api-access-sxwzf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:34:21.089121 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.089069 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sxwzf\" (UniqueName: \"kubernetes.io/projected/d3ef617e-be2b-4489-b1f9-c1a172b9a348-kube-api-access-sxwzf\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:34:21.564438 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.564403 2575 generic.go:356] "Generic (PLEG): container finished" podID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" containerID="aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53" exitCode=0 Jun 05 14:34:21.564876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.564449 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" Jun 05 14:34:21.564876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.564488 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" event={"ID":"d3ef617e-be2b-4489-b1f9-c1a172b9a348","Type":"ContainerDied","Data":"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53"} Jun 05 14:34:21.564876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.564545 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-b9hzm" event={"ID":"d3ef617e-be2b-4489-b1f9-c1a172b9a348","Type":"ContainerDied","Data":"38f7765f3b95f9f353a6118fb8734911b82fefc93bcb77353001397c7ad17d6c"} Jun 05 14:34:21.564876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.564570 2575 scope.go:117] "RemoveContainer" containerID="aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53" Jun 05 14:34:21.575071 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.575052 2575 scope.go:117] "RemoveContainer" containerID="aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53" Jun 05 14:34:21.575379 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:34:21.575361 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53\": container with ID starting with aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53 not found: ID does not exist" containerID="aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53" Jun 05 14:34:21.575424 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.575389 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53"} err="failed to get container status \"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53\": rpc error: code = NotFound desc = could not find container \"aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53\": container with ID starting with aee283b339f8f29038973067e9fc3faafd789c9654fe39a7e34ad308ea5c3e53 not found: ID does not exist" Jun 05 14:34:21.588382 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.588358 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:21.592508 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:21.592487 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-b9hzm"] Jun 05 14:34:22.126890 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:22.126859 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" path="/var/lib/kubelet/pods/d3ef617e-be2b-4489-b1f9-c1a172b9a348/volumes" Jun 05 14:34:28.773619 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:28.773568 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:28.774034 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:28.773646 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:28.795986 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:28.795954 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:29.624509 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:29.624482 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-sw5bd" Jun 05 14:34:40.976752 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:40.976669 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:41.337760 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:41.337717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:42.567476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:42.567440 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:44.617908 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.617870 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l7b67"] Jun 05 14:34:44.618280 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.618235 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" containerName="registry-server" Jun 05 14:34:44.618280 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.618247 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" containerName="registry-server" Jun 05 14:34:44.618378 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.618300 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3ef617e-be2b-4489-b1f9-c1a172b9a348" containerName="registry-server" Jun 05 14:34:44.633180 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.633148 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l7b67"] Jun 05 14:34:44.633348 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.633290 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:44.636015 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.635994 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-xr5gv\"" Jun 05 14:34:44.703538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.703500 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b62gt\" (UniqueName: \"kubernetes.io/projected/c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817-kube-api-access-b62gt\") pod \"authorino-operator-75cc8d5cb7-l7b67\" (UID: \"c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:44.804821 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.804784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b62gt\" (UniqueName: \"kubernetes.io/projected/c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817-kube-api-access-b62gt\") pod \"authorino-operator-75cc8d5cb7-l7b67\" (UID: \"c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:44.812974 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.812936 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b62gt\" (UniqueName: \"kubernetes.io/projected/c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817-kube-api-access-b62gt\") pod \"authorino-operator-75cc8d5cb7-l7b67\" (UID: \"c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:44.943043 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:44.942953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:45.075607 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:45.075481 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-l7b67"] Jun 05 14:34:45.078017 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:34:45.077992 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f6aaa3_5ddb_45d9_866e_f8a0cd2ef817.slice/crio-cc7a8eab923cf28448d518a848c144009b64aef38cbbb81ad983bc071830b2b7 WatchSource:0}: Error finding container cc7a8eab923cf28448d518a848c144009b64aef38cbbb81ad983bc071830b2b7: Status 404 returned error can't find the container with id cc7a8eab923cf28448d518a848c144009b64aef38cbbb81ad983bc071830b2b7 Jun 05 14:34:45.674570 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:45.674525 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" event={"ID":"c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817","Type":"ContainerStarted","Data":"cc7a8eab923cf28448d518a848c144009b64aef38cbbb81ad983bc071830b2b7"} Jun 05 14:34:45.956607 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:45.956498 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:47.685632 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:47.685594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" event={"ID":"c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817","Type":"ContainerStarted","Data":"99aa6f8eb28acc1643f49d5d0eccadb4aecc6aaf7a89eefbe712c7a0b622fe32"} Jun 05 14:34:47.686033 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:47.685695 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:34:47.701896 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:47.701841 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" podStartSLOduration=1.476001567 podStartE2EDuration="3.701825523s" totalImagesPullingTime="2.225823956s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:34:47.701056959 +0000 UTC m=+1432.003839452" watchObservedRunningTime="2026-06-05 14:34:47.701825523 +0000 UTC m=+1432.004608016" Jun 05 14:34:48.262782 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.262749 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl"] Jun 05 14:34:48.266137 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.266119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:48.268918 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.268899 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-7nzsv\"" Jun 05 14:34:48.276822 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.276731 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl"] Jun 05 14:34:48.345891 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.345849 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t7hc\" (UniqueName: \"kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc\") pod \"limitador-operator-controller-manager-859d7b78bd-gkbvl\" (UID: \"3e385603-923b-4e7d-aa64-4d2aca81b27a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:48.447011 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.446966 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t7hc\" (UniqueName: \"kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc\") pod \"limitador-operator-controller-manager-859d7b78bd-gkbvl\" (UID: \"3e385603-923b-4e7d-aa64-4d2aca81b27a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:48.455066 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.455034 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t7hc\" (UniqueName: \"kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc\") pod \"limitador-operator-controller-manager-859d7b78bd-gkbvl\" (UID: \"3e385603-923b-4e7d-aa64-4d2aca81b27a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:48.577604 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.577566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:48.712014 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.711987 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl"] Jun 05 14:34:48.714480 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:34:48.714449 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e385603_923b_4e7d_aa64_4d2aca81b27a.slice/crio-2f46b577436053c4c40c977479c76cd4df0932cd81784704217e8f70c65aa966 WatchSource:0}: Error finding container 2f46b577436053c4c40c977479c76cd4df0932cd81784704217e8f70c65aa966: Status 404 returned error can't find the container with id 2f46b577436053c4c40c977479c76cd4df0932cd81784704217e8f70c65aa966 Jun 05 14:34:48.946801 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:48.946699 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:49.699486 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:49.699443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" event={"ID":"3e385603-923b-4e7d-aa64-4d2aca81b27a","Type":"ContainerStarted","Data":"2f46b577436053c4c40c977479c76cd4df0932cd81784704217e8f70c65aa966"} Jun 05 14:34:50.388792 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:50.388741 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:51.710947 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:51.710914 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" event={"ID":"3e385603-923b-4e7d-aa64-4d2aca81b27a","Type":"ContainerStarted","Data":"a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309"} Jun 05 14:34:51.711400 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:51.711044 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:34:51.729096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:51.729040 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" podStartSLOduration=1.792550512 podStartE2EDuration="3.729023923s" totalImagesPullingTime="1.936473411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:34:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:34:51.727508146 +0000 UTC m=+1436.030290631" watchObservedRunningTime="2026-06-05 14:34:51.729023923 +0000 UTC m=+1436.031806415" Jun 05 14:34:51.785334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:51.785290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:53.170707 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:53.170666 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:54.506891 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.506855 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:54.845639 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.845604 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558"] Jun 05 14:34:54.852303 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.852279 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:54.854987 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.854967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-grftd\"" Jun 05 14:34:54.854987 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.854982 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 14:34:54.861288 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:54.861264 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558"] Jun 05 14:34:55.012580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.012547 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwsh5\" (UniqueName: \"kubernetes.io/projected/c8a5820e-f89c-4764-a8a5-02367bc8e45a-kube-api-access-jwsh5\") pod \"dns-operator-controller-manager-864dd78c4c-vx558\" (UID: \"c8a5820e-f89c-4764-a8a5-02367bc8e45a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:55.113171 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.113069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwsh5\" (UniqueName: \"kubernetes.io/projected/c8a5820e-f89c-4764-a8a5-02367bc8e45a-kube-api-access-jwsh5\") pod \"dns-operator-controller-manager-864dd78c4c-vx558\" (UID: \"c8a5820e-f89c-4764-a8a5-02367bc8e45a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:55.123687 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.123658 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwsh5\" (UniqueName: \"kubernetes.io/projected/c8a5820e-f89c-4764-a8a5-02367bc8e45a-kube-api-access-jwsh5\") pod \"dns-operator-controller-manager-864dd78c4c-vx558\" (UID: \"c8a5820e-f89c-4764-a8a5-02367bc8e45a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:55.162543 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.162510 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:55.318312 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.318290 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558"] Jun 05 14:34:55.320679 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:34:55.320651 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8a5820e_f89c_4764_a8a5_02367bc8e45a.slice/crio-01ecbee5d34e577fcd092b4da6659bfc5cb718a10df4cd398786ae6ce72dd48e WatchSource:0}: Error finding container 01ecbee5d34e577fcd092b4da6659bfc5cb718a10df4cd398786ae6ce72dd48e: Status 404 returned error can't find the container with id 01ecbee5d34e577fcd092b4da6659bfc5cb718a10df4cd398786ae6ce72dd48e Jun 05 14:34:55.731902 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:55.731860 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" event={"ID":"c8a5820e-f89c-4764-a8a5-02367bc8e45a","Type":"ContainerStarted","Data":"01ecbee5d34e577fcd092b4da6659bfc5cb718a10df4cd398786ae6ce72dd48e"} Jun 05 14:34:56.352494 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:56.352437 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:56.450391 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:56.450300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:56.767880 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:56.767788 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:56.854235 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:56.854160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:34:57.521919 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:57.521893 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 05 14:34:57.743332 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:57.743298 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" event={"ID":"c8a5820e-f89c-4764-a8a5-02367bc8e45a","Type":"ContainerStarted","Data":"cd3f2c6373d265089372c79f6742c02b1489653625ff7271109328c092054bd5"} Jun 05 14:34:57.743513 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:57.743428 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:34:57.761630 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:57.761580 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" podStartSLOduration=1.56510169 podStartE2EDuration="3.761566076s" totalImagesPullingTime="2.196464386s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:34:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:34:57.760932457 +0000 UTC m=+1442.063714951" watchObservedRunningTime="2026-06-05 14:34:57.761566076 +0000 UTC m=+1442.064348569" Jun 05 14:34:58.695116 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:34:58.695087 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-l7b67" Jun 05 14:35:00.341396 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:00.341360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:00.443537 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:00.443487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:00.839523 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:00.839470 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:01.129501 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:01.129385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:02.719063 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:02.719028 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:35:03.568361 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:03.568318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:03.670024 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:03.669986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:08.750766 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:08.750733 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-vx558" Jun 05 14:35:09.468374 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:09.468332 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:11.874770 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.874725 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl"] Jun 05 14:35:11.875320 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.874993 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" containerName="manager" containerID="cri-o://a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309" gracePeriod=2 Jun 05 14:35:11.887309 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.887278 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl"] Jun 05 14:35:11.903501 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.903468 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd"] Jun 05 14:35:11.904055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.904033 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" containerName="manager" Jun 05 14:35:11.904055 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.904057 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" containerName="manager" Jun 05 14:35:11.904249 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.904158 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" containerName="manager" Jun 05 14:35:11.907387 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.907365 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:11.910463 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:35:11.910439 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gkbvl\" is forbidden: User \"system:node:ip-10-0-141-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-39.ec2.internal' and this object" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:35:11.919850 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.919826 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd"] Jun 05 14:35:11.960661 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:11.960632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rccgc\" (UniqueName: \"kubernetes.io/projected/5750a555-7a23-4319-8d0b-2d1937183276-kube-api-access-rccgc\") pod \"limitador-operator-controller-manager-859d7b78bd-7v5pd\" (UID: \"5750a555-7a23-4319-8d0b-2d1937183276\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:12.061836 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.061803 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rccgc\" (UniqueName: \"kubernetes.io/projected/5750a555-7a23-4319-8d0b-2d1937183276-kube-api-access-rccgc\") pod \"limitador-operator-controller-manager-859d7b78bd-7v5pd\" (UID: \"5750a555-7a23-4319-8d0b-2d1937183276\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:12.074078 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.074046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rccgc\" (UniqueName: \"kubernetes.io/projected/5750a555-7a23-4319-8d0b-2d1937183276-kube-api-access-rccgc\") pod \"limitador-operator-controller-manager-859d7b78bd-7v5pd\" (UID: \"5750a555-7a23-4319-8d0b-2d1937183276\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:12.119721 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.119698 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:35:12.122172 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:35:12.122140 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-gkbvl\" is forbidden: User \"system:node:ip-10-0-141-39.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-39.ec2.internal' and this object" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:35:12.162793 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.162708 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t7hc\" (UniqueName: \"kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc\") pod \"3e385603-923b-4e7d-aa64-4d2aca81b27a\" (UID: \"3e385603-923b-4e7d-aa64-4d2aca81b27a\") " Jun 05 14:35:12.164778 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.164744 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc" (OuterVolumeSpecName: "kube-api-access-5t7hc") pod "3e385603-923b-4e7d-aa64-4d2aca81b27a" (UID: "3e385603-923b-4e7d-aa64-4d2aca81b27a"). InnerVolumeSpecName "kube-api-access-5t7hc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:35:12.169079 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.169053 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:12.249741 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.249707 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:12.263837 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.263812 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t7hc\" (UniqueName: \"kubernetes.io/projected/3e385603-923b-4e7d-aa64-4d2aca81b27a-kube-api-access-5t7hc\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:35:12.270442 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.270395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:12.387459 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.387428 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd"] Jun 05 14:35:12.391127 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:35:12.391095 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5750a555_7a23_4319_8d0b_2d1937183276.slice/crio-f15729285b39f68993e553a57cf96d7a393f9a6ff764924ee08cbbdb5c7d7ce0 WatchSource:0}: Error finding container f15729285b39f68993e553a57cf96d7a393f9a6ff764924ee08cbbdb5c7d7ce0: Status 404 returned error can't find the container with id f15729285b39f68993e553a57cf96d7a393f9a6ff764924ee08cbbdb5c7d7ce0 Jun 05 14:35:12.828548 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.828516 2575 generic.go:356] "Generic (PLEG): container finished" podID="3e385603-923b-4e7d-aa64-4d2aca81b27a" containerID="a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309" exitCode=0 Jun 05 14:35:12.828735 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.828568 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-gkbvl" Jun 05 14:35:12.828735 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.828617 2575 scope.go:117] "RemoveContainer" containerID="a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309" Jun 05 14:35:12.830317 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.830296 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" event={"ID":"5750a555-7a23-4319-8d0b-2d1937183276","Type":"ContainerStarted","Data":"adfab54f5ef153583625ae5e03fbb6e4fcfef931190b3a13b8e8224110bcd77b"} Jun 05 14:35:12.830430 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.830347 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" event={"ID":"5750a555-7a23-4319-8d0b-2d1937183276","Type":"ContainerStarted","Data":"f15729285b39f68993e553a57cf96d7a393f9a6ff764924ee08cbbdb5c7d7ce0"} Jun 05 14:35:12.830499 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.830444 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:12.837688 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.837672 2575 scope.go:117] "RemoveContainer" containerID="a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309" Jun 05 14:35:12.837964 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:35:12.837942 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309\": container with ID starting with a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309 not found: ID does not exist" containerID="a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309" Jun 05 14:35:12.838016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.837972 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309"} err="failed to get container status \"a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309\": rpc error: code = NotFound desc = could not find container \"a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309\": container with ID starting with a8ff60537847678089df78d22895a72e50ee0fbcf4dcc654d6deecda0dfd0309 not found: ID does not exist" Jun 05 14:35:12.855545 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:12.855496 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" podStartSLOduration=1.855480804 podStartE2EDuration="1.855480804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:35:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:35:12.854299888 +0000 UTC m=+1457.157082382" watchObservedRunningTime="2026-06-05 14:35:12.855480804 +0000 UTC m=+1457.158263297" Jun 05 14:35:14.127047 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:14.127010 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e385603-923b-4e7d-aa64-4d2aca81b27a" path="/var/lib/kubelet/pods/3e385603-923b-4e7d-aa64-4d2aca81b27a/volumes" Jun 05 14:35:17.760538 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:17.760497 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:17.859349 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:17.859318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:18.359816 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:18.359780 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:18.436224 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:18.436168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:22.165675 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:22.165635 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:22.322115 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:22.322074 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:23.844826 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:23.844796 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7v5pd" Jun 05 14:35:25.770785 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:25.770752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:25.899915 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:25.899870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:31.185585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:31.185547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:32.670703 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:32.670667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:32.762598 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:32.762561 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:41.538804 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.538767 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd"] Jun 05 14:35:41.547432 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.547398 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.550187 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.550161 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-mkzdr\"" Jun 05 14:35:41.553921 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.553897 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd"] Jun 05 14:35:41.573763 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.573726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:41.627007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.626967 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627010 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37b2efec-939a-4544-be80-6de06a2318bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627035 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627054 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37b2efec-939a-4544-be80-6de06a2318bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627152 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627258 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627178 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ps9z\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-kube-api-access-6ps9z\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627443 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.627443 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.627337 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.637489 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.637451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:41.728522 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728480 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728718 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728529 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ps9z\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-kube-api-access-6ps9z\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728718 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728590 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728718 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728718 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728652 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728718 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728688 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37b2efec-939a-4544-be80-6de06a2318bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728795 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728859 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728913 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37b2efec-939a-4544-be80-6de06a2318bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.728997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.728928 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.729240 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.729125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.729240 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.729138 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.729367 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.729254 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.729482 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.729463 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37b2efec-939a-4544-be80-6de06a2318bd-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.730927 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.730897 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37b2efec-939a-4544-be80-6de06a2318bd-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.731389 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.731372 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37b2efec-939a-4544-be80-6de06a2318bd-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.737669 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.737639 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.738146 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.738125 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ps9z\" (UniqueName: \"kubernetes.io/projected/37b2efec-939a-4544-be80-6de06a2318bd-kube-api-access-6ps9z\") pod \"maas-default-gateway-openshift-default-687ff6996-svksd\" (UID: \"37b2efec-939a-4544-be80-6de06a2318bd\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:41.861484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:41.861444 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:42.005252 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.005218 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd"] Jun 05 14:35:42.007617 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:35:42.007585 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37b2efec_939a_4544_be80_6de06a2318bd.slice/crio-59ce7652582c735dc3e34130f7bdf6e66feba59422da3d986dfb47283d7b3c9c WatchSource:0}: Error finding container 59ce7652582c735dc3e34130f7bdf6e66feba59422da3d986dfb47283d7b3c9c: Status 404 returned error can't find the container with id 59ce7652582c735dc3e34130f7bdf6e66feba59422da3d986dfb47283d7b3c9c Jun 05 14:35:42.009727 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.009693 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:35:42.009836 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.009777 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:35:42.009836 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.009820 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:35:42.982443 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.982407 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" event={"ID":"37b2efec-939a-4544-be80-6de06a2318bd","Type":"ContainerStarted","Data":"b178339147efcc29b0efbb959149ac14d87c44f58942c5a83b98e325a6872d77"} Jun 05 14:35:42.982837 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:42.982466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" event={"ID":"37b2efec-939a-4544-be80-6de06a2318bd","Type":"ContainerStarted","Data":"59ce7652582c735dc3e34130f7bdf6e66feba59422da3d986dfb47283d7b3c9c"} Jun 05 14:35:43.007095 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:43.007042 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" podStartSLOduration=2.007024841 podStartE2EDuration="2.007024841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:35:43.006460299 +0000 UTC m=+1487.309242804" watchObservedRunningTime="2026-06-05 14:35:43.007024841 +0000 UTC m=+1487.309807333" Jun 05 14:35:43.862282 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:43.862246 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:43.867838 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:43.867812 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:43.987648 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:43.987611 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:43.988531 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:43.988513 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:35:45.433939 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:45.433886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:52.743118 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:52.743080 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:52.820013 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:52.819973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:56.081116 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.081073 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:56.193062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.193035 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:35:56.193562 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.193534 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:56.196789 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.196765 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:35:56.202660 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.202637 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:35:56.205837 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.205817 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:35:56.337588 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:56.337485 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:57.014359 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.014316 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:35:57.018697 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.018677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:35:57.023065 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.023039 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nt4kl\"" Jun 05 14:35:57.032140 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.032118 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:35:57.060246 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.060185 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:57.157600 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.157567 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:35:57.168603 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.168573 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wdvh\" (UniqueName: \"kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh\") pod \"authorino-58cd955675-ds4jt\" (UID: \"bac6c30b-a7d7-4c4e-9434-035e9e37ed53\") " pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:35:57.234726 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.234690 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:35:57.238192 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.238167 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:35:57.248690 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.248666 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:35:57.269415 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.269332 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wdvh\" (UniqueName: \"kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh\") pod \"authorino-58cd955675-ds4jt\" (UID: \"bac6c30b-a7d7-4c4e-9434-035e9e37ed53\") " pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:35:57.281003 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.280971 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wdvh\" (UniqueName: \"kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh\") pod \"authorino-58cd955675-ds4jt\" (UID: \"bac6c30b-a7d7-4c4e-9434-035e9e37ed53\") " pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:35:57.339864 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.339829 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:35:57.370223 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.370153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7stc8\" (UniqueName: \"kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8\") pod \"authorino-75d556bd77-fdffq\" (UID: \"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f\") " pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:35:57.470767 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.470727 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7stc8\" (UniqueName: \"kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8\") pod \"authorino-75d556bd77-fdffq\" (UID: \"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f\") " pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:35:57.483484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.483458 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7stc8\" (UniqueName: \"kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8\") pod \"authorino-75d556bd77-fdffq\" (UID: \"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f\") " pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:35:57.496445 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.496241 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:35:57.499242 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:35:57.499192 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbac6c30b_a7d7_4c4e_9434_035e9e37ed53.slice/crio-a56d45c451afa32e55fa56a3734940a8dd1b509bf32c446f298f9b34c953ede7 WatchSource:0}: Error finding container a56d45c451afa32e55fa56a3734940a8dd1b509bf32c446f298f9b34c953ede7: Status 404 returned error can't find the container with id a56d45c451afa32e55fa56a3734940a8dd1b509bf32c446f298f9b34c953ede7 Jun 05 14:35:57.548267 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.548151 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:35:57.685584 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:57.685548 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:35:57.690539 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:35:57.690509 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8c49ec74_70f9_4748_ad22_ea6f1ad5a66f.slice/crio-608c01752a0b9ace068e49e601739fad965983927a8dd4dba0b753cc369dc2ab WatchSource:0}: Error finding container 608c01752a0b9ace068e49e601739fad965983927a8dd4dba0b753cc369dc2ab: Status 404 returned error can't find the container with id 608c01752a0b9ace068e49e601739fad965983927a8dd4dba0b753cc369dc2ab Jun 05 14:35:58.055841 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:58.055802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ds4jt" event={"ID":"bac6c30b-a7d7-4c4e-9434-035e9e37ed53","Type":"ContainerStarted","Data":"a56d45c451afa32e55fa56a3734940a8dd1b509bf32c446f298f9b34c953ede7"} Jun 05 14:35:58.056880 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:35:58.056854 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdffq" event={"ID":"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f","Type":"ContainerStarted","Data":"608c01752a0b9ace068e49e601739fad965983927a8dd4dba0b753cc369dc2ab"} Jun 05 14:36:02.081272 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:02.081231 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ds4jt" event={"ID":"bac6c30b-a7d7-4c4e-9434-035e9e37ed53","Type":"ContainerStarted","Data":"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31"} Jun 05 14:36:02.082802 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:02.082774 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdffq" event={"ID":"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f","Type":"ContainerStarted","Data":"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4"} Jun 05 14:36:02.098426 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:02.098380 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-ds4jt" podStartSLOduration=2.550016288 podStartE2EDuration="6.098365348s" totalImagesPullingTime="3.54834906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:36:02.097335354 +0000 UTC m=+1506.400117848" watchObservedRunningTime="2026-06-05 14:36:02.098365348 +0000 UTC m=+1506.401147841" Jun 05 14:36:02.116390 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:02.116340 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-fdffq" podStartSLOduration=1.770258701 podStartE2EDuration="5.116324356s" totalImagesPullingTime="3.346065655s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:35:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:36:02.115243268 +0000 UTC m=+1506.418025762" watchObservedRunningTime="2026-06-05 14:36:02.116324356 +0000 UTC m=+1506.419106848" Jun 05 14:36:02.145597 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:02.145562 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:36:04.098476 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:04.098436 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-ds4jt" podUID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" containerName="authorino" containerID="cri-o://3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31" gracePeriod=30 Jun 05 14:36:04.354640 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:04.354567 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:36:04.434604 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:04.434566 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wdvh\" (UniqueName: \"kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh\") pod \"bac6c30b-a7d7-4c4e-9434-035e9e37ed53\" (UID: \"bac6c30b-a7d7-4c4e-9434-035e9e37ed53\") " Jun 05 14:36:04.436716 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:04.436686 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh" (OuterVolumeSpecName: "kube-api-access-7wdvh") pod "bac6c30b-a7d7-4c4e-9434-035e9e37ed53" (UID: "bac6c30b-a7d7-4c4e-9434-035e9e37ed53"). InnerVolumeSpecName "kube-api-access-7wdvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:36:04.536183 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:04.536146 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wdvh\" (UniqueName: \"kubernetes.io/projected/bac6c30b-a7d7-4c4e-9434-035e9e37ed53-kube-api-access-7wdvh\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:36:05.103683 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.103648 2575 generic.go:356] "Generic (PLEG): container finished" podID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" containerID="3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31" exitCode=0 Jun 05 14:36:05.104096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.103688 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-ds4jt" Jun 05 14:36:05.104096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.103720 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ds4jt" event={"ID":"bac6c30b-a7d7-4c4e-9434-035e9e37ed53","Type":"ContainerDied","Data":"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31"} Jun 05 14:36:05.104096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.103750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-ds4jt" event={"ID":"bac6c30b-a7d7-4c4e-9434-035e9e37ed53","Type":"ContainerDied","Data":"a56d45c451afa32e55fa56a3734940a8dd1b509bf32c446f298f9b34c953ede7"} Jun 05 14:36:05.104096 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.103767 2575 scope.go:117] "RemoveContainer" containerID="3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31" Jun 05 14:36:05.112633 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.112615 2575 scope.go:117] "RemoveContainer" containerID="3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31" Jun 05 14:36:05.112893 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:36:05.112872 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31\": container with ID starting with 3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31 not found: ID does not exist" containerID="3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31" Jun 05 14:36:05.112948 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.112901 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31"} err="failed to get container status \"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31\": rpc error: code = NotFound desc = could not find container \"3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31\": container with ID starting with 3eefc33ec49fad189f4f990d69a143252337de34c4871118518bcf9486a65b31 not found: ID does not exist" Jun 05 14:36:05.124536 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.124511 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:36:05.128010 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:05.127988 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-ds4jt"] Jun 05 14:36:06.126822 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:06.126788 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" path="/var/lib/kubelet/pods/bac6c30b-a7d7-4c4e-9434-035e9e37ed53/volumes" Jun 05 14:36:17.310029 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:17.309938 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:36:28.850149 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:28.850099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:36:28.947252 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:28.947190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:36:29.118229 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:29.118113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:36:43.113451 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.113415 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8fhq5"] Jun 05 14:36:43.113951 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.113876 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" containerName="authorino" Jun 05 14:36:43.113951 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.113892 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" containerName="authorino" Jun 05 14:36:43.113951 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.113950 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bac6c30b-a7d7-4c4e-9434-035e9e37ed53" containerName="authorino" Jun 05 14:36:43.118413 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.118352 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" Jun 05 14:36:43.121640 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.121618 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 05 14:36:43.122747 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.122728 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 05 14:36:43.122835 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.122728 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-4h8k2\"" Jun 05 14:36:43.148719 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.148691 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8fhq5"] Jun 05 14:36:43.292539 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.292502 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7g25\" (UniqueName: \"kubernetes.io/projected/42e23edc-19c1-46cd-8fb4-1553198334c7-kube-api-access-g7g25\") pod \"keycloak-operator-dd84cbf46-8fhq5\" (UID: \"42e23edc-19c1-46cd-8fb4-1553198334c7\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" Jun 05 14:36:43.393414 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.393316 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7g25\" (UniqueName: \"kubernetes.io/projected/42e23edc-19c1-46cd-8fb4-1553198334c7-kube-api-access-g7g25\") pod \"keycloak-operator-dd84cbf46-8fhq5\" (UID: \"42e23edc-19c1-46cd-8fb4-1553198334c7\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" Jun 05 14:36:43.402674 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.402644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7g25\" (UniqueName: \"kubernetes.io/projected/42e23edc-19c1-46cd-8fb4-1553198334c7-kube-api-access-g7g25\") pod \"keycloak-operator-dd84cbf46-8fhq5\" (UID: \"42e23edc-19c1-46cd-8fb4-1553198334c7\") " pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" Jun 05 14:36:43.432484 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.432453 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" Jun 05 14:36:43.566425 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:43.566301 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-dd84cbf46-8fhq5"] Jun 05 14:36:43.568853 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:36:43.568821 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e23edc_19c1_46cd_8fb4_1553198334c7.slice/crio-26086b4db5381fe10a28dedc9a840769b81f36bd17c29629de6801305e39abdc WatchSource:0}: Error finding container 26086b4db5381fe10a28dedc9a840769b81f36bd17c29629de6801305e39abdc: Status 404 returned error can't find the container with id 26086b4db5381fe10a28dedc9a840769b81f36bd17c29629de6801305e39abdc Jun 05 14:36:44.304525 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:44.304443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" event={"ID":"42e23edc-19c1-46cd-8fb4-1553198334c7","Type":"ContainerStarted","Data":"26086b4db5381fe10a28dedc9a840769b81f36bd17c29629de6801305e39abdc"} Jun 05 14:36:50.338999 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:50.338954 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" event={"ID":"42e23edc-19c1-46cd-8fb4-1553198334c7","Type":"ContainerStarted","Data":"f97b2ed65679dc776f7f558162caf86b7bebc597ff08261e95f02db77afcd0ca"} Jun 05 14:36:50.355733 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:50.355678 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-dd84cbf46-8fhq5" podStartSLOduration=1.139461934 podStartE2EDuration="7.355663749s" totalImagesPullingTime="6.216201815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:36:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:36:50.354725826 +0000 UTC m=+1554.657508320" watchObservedRunningTime="2026-06-05 14:36:50.355663749 +0000 UTC m=+1554.658446242" Jun 05 14:36:58.956472 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:36:58.956429 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:00.146359 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:00.146326 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:12.274252 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:12.274214 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:29.430749 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.430707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:29.654580 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.654546 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d5k2l"] Jun 05 14:37:29.658325 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.658300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:29.664406 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.664372 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d5k2l"] Jun 05 14:37:29.823338 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.823304 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv6kp\" (UniqueName: \"kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp\") pod \"authorino-5d4b67c446-d5k2l\" (UID: \"3bd748ce-2f39-44b8-8947-82ac4ac3b883\") " pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:29.888968 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.888934 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:29.895218 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.895169 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d5k2l"] Jun 05 14:37:29.895543 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:37:29.895517 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-dv6kp], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-d5k2l" podUID="3bd748ce-2f39-44b8-8947-82ac4ac3b883" Jun 05 14:37:29.915887 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.915851 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:29.919391 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.919374 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:29.924040 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.924015 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv6kp\" (UniqueName: \"kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp\") pod \"authorino-5d4b67c446-d5k2l\" (UID: \"3bd748ce-2f39-44b8-8947-82ac4ac3b883\") " pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:29.924310 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.924286 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjmr6\" (UniqueName: \"kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6\") pod \"authorino-6787df6784-h4942\" (UID: \"0304b321-345b-4d6f-ac4c-240a1c44582a\") " pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:29.926540 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.926518 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:29.932066 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:29.932034 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv6kp\" (UniqueName: \"kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp\") pod \"authorino-5d4b67c446-d5k2l\" (UID: \"3bd748ce-2f39-44b8-8947-82ac4ac3b883\") " pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:30.025416 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.025378 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjmr6\" (UniqueName: \"kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6\") pod \"authorino-6787df6784-h4942\" (UID: \"0304b321-345b-4d6f-ac4c-240a1c44582a\") " pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:30.033695 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.033662 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjmr6\" (UniqueName: \"kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6\") pod \"authorino-6787df6784-h4942\" (UID: \"0304b321-345b-4d6f-ac4c-240a1c44582a\") " pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:30.084144 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.084062 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:30.084361 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.084348 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:30.108592 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.108557 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:37:30.113142 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.113119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.115945 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.115895 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 05 14:37:30.117547 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.117520 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:37:30.126383 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.126360 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.126498 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.126388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv7v8\" (UniqueName: \"kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.226835 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.226801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.226835 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.226838 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv7v8\" (UniqueName: \"kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.229813 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.229785 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.231669 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.231646 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:30.233992 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:37:30.233958 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0304b321_345b_4d6f_ac4c_240a1c44582a.slice/crio-bf1c417cbbcb02648a2aefba647aee64f800a1bc51bc7282b2b34cc03d1637a0 WatchSource:0}: Error finding container bf1c417cbbcb02648a2aefba647aee64f800a1bc51bc7282b2b34cc03d1637a0: Status 404 returned error can't find the container with id bf1c417cbbcb02648a2aefba647aee64f800a1bc51bc7282b2b34cc03d1637a0 Jun 05 14:37:30.234669 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.234649 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv7v8\" (UniqueName: \"kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8\") pod \"authorino-85d6f6767b-vbz64\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.426648 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.426543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:37:30.529997 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.529957 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6787df6784-h4942" event={"ID":"0304b321-345b-4d6f-ac4c-240a1c44582a","Type":"ContainerStarted","Data":"bf1c417cbbcb02648a2aefba647aee64f800a1bc51bc7282b2b34cc03d1637a0"} Jun 05 14:37:30.530459 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.530028 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:30.540546 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.540520 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:30.561602 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.561571 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:37:30.563260 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:37:30.563227 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6df48db_3826_48fd_a21b_00b4a4c52654.slice/crio-b6556ceff27889a486a963080d2dd7de36da22edbc33a0bda893f62262633ea5 WatchSource:0}: Error finding container b6556ceff27889a486a963080d2dd7de36da22edbc33a0bda893f62262633ea5: Status 404 returned error can't find the container with id b6556ceff27889a486a963080d2dd7de36da22edbc33a0bda893f62262633ea5 Jun 05 14:37:30.630111 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.630088 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv6kp\" (UniqueName: \"kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp\") pod \"3bd748ce-2f39-44b8-8947-82ac4ac3b883\" (UID: \"3bd748ce-2f39-44b8-8947-82ac4ac3b883\") " Jun 05 14:37:30.632087 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.632060 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp" (OuterVolumeSpecName: "kube-api-access-dv6kp") pod "3bd748ce-2f39-44b8-8947-82ac4ac3b883" (UID: "3bd748ce-2f39-44b8-8947-82ac4ac3b883"). InnerVolumeSpecName "kube-api-access-dv6kp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:37:30.731461 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:30.731372 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv6kp\" (UniqueName: \"kubernetes.io/projected/3bd748ce-2f39-44b8-8947-82ac4ac3b883-kube-api-access-dv6kp\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:37:31.537181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.537143 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6f6767b-vbz64" event={"ID":"b6df48db-3826-48fd-a21b-00b4a4c52654","Type":"ContainerStarted","Data":"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc"} Jun 05 14:37:31.537181 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.537193 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6f6767b-vbz64" event={"ID":"b6df48db-3826-48fd-a21b-00b4a4c52654","Type":"ContainerStarted","Data":"b6556ceff27889a486a963080d2dd7de36da22edbc33a0bda893f62262633ea5"} Jun 05 14:37:31.538884 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.538857 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6787df6784-h4942" event={"ID":"0304b321-345b-4d6f-ac4c-240a1c44582a","Type":"ContainerStarted","Data":"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba"} Jun 05 14:37:31.538884 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.538873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-d5k2l" Jun 05 14:37:31.539084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.538941 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6787df6784-h4942" podUID="0304b321-345b-4d6f-ac4c-240a1c44582a" containerName="authorino" containerID="cri-o://96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba" gracePeriod=30 Jun 05 14:37:31.554295 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.554248 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85d6f6767b-vbz64" podStartSLOduration=1.260248725 podStartE2EDuration="1.554232537s" totalImagesPullingTime="293.983812ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:37:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:37:31.552695886 +0000 UTC m=+1595.855478391" watchObservedRunningTime="2026-06-05 14:37:31.554232537 +0000 UTC m=+1595.857015027" Jun 05 14:37:31.581712 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.581671 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d5k2l"] Jun 05 14:37:31.585244 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.585186 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:37:31.585423 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.585395 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-fdffq" podUID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" containerName="authorino" containerID="cri-o://ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4" gracePeriod=30 Jun 05 14:37:31.588433 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.588409 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-d5k2l"] Jun 05 14:37:31.606013 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.605969 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6787df6784-h4942" podStartSLOduration=2.256611516 podStartE2EDuration="2.605952225s" totalImagesPullingTime="349.340709ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:37:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:37:31.604667684 +0000 UTC m=+1595.907450179" watchObservedRunningTime="2026-06-05 14:37:31.605952225 +0000 UTC m=+1595.908734717" Jun 05 14:37:31.860847 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.860823 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:31.864386 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.864362 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:37:31.941702 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.941666 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7stc8\" (UniqueName: \"kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8\") pod \"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f\" (UID: \"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f\") " Jun 05 14:37:31.941879 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.941738 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjmr6\" (UniqueName: \"kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6\") pod \"0304b321-345b-4d6f-ac4c-240a1c44582a\" (UID: \"0304b321-345b-4d6f-ac4c-240a1c44582a\") " Jun 05 14:37:31.943900 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.943866 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6" (OuterVolumeSpecName: "kube-api-access-sjmr6") pod "0304b321-345b-4d6f-ac4c-240a1c44582a" (UID: "0304b321-345b-4d6f-ac4c-240a1c44582a"). InnerVolumeSpecName "kube-api-access-sjmr6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:37:31.944016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:31.943902 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8" (OuterVolumeSpecName: "kube-api-access-7stc8") pod "8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" (UID: "8c49ec74-70f9-4748-ad22-ea6f1ad5a66f"). InnerVolumeSpecName "kube-api-access-7stc8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:37:32.042634 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.042587 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7stc8\" (UniqueName: \"kubernetes.io/projected/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f-kube-api-access-7stc8\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:37:32.042634 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.042628 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjmr6\" (UniqueName: \"kubernetes.io/projected/0304b321-345b-4d6f-ac4c-240a1c44582a-kube-api-access-sjmr6\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:37:32.132772 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.132685 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bd748ce-2f39-44b8-8947-82ac4ac3b883" path="/var/lib/kubelet/pods/3bd748ce-2f39-44b8-8947-82ac4ac3b883/volumes" Jun 05 14:37:32.545763 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.545673 2575 generic.go:356] "Generic (PLEG): container finished" podID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" containerID="ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4" exitCode=0 Jun 05 14:37:32.545763 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.545727 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-fdffq" Jun 05 14:37:32.545763 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.545750 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdffq" event={"ID":"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f","Type":"ContainerDied","Data":"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4"} Jun 05 14:37:32.546338 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.545782 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-fdffq" event={"ID":"8c49ec74-70f9-4748-ad22-ea6f1ad5a66f","Type":"ContainerDied","Data":"608c01752a0b9ace068e49e601739fad965983927a8dd4dba0b753cc369dc2ab"} Jun 05 14:37:32.546338 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.545801 2575 scope.go:117] "RemoveContainer" containerID="ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4" Jun 05 14:37:32.547124 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.547069 2575 generic.go:356] "Generic (PLEG): container finished" podID="0304b321-345b-4d6f-ac4c-240a1c44582a" containerID="96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba" exitCode=0 Jun 05 14:37:32.547124 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.547115 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6787df6784-h4942" event={"ID":"0304b321-345b-4d6f-ac4c-240a1c44582a","Type":"ContainerDied","Data":"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba"} Jun 05 14:37:32.547256 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.547124 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6787df6784-h4942" Jun 05 14:37:32.547256 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.547147 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6787df6784-h4942" event={"ID":"0304b321-345b-4d6f-ac4c-240a1c44582a","Type":"ContainerDied","Data":"bf1c417cbbcb02648a2aefba647aee64f800a1bc51bc7282b2b34cc03d1637a0"} Jun 05 14:37:32.559585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.559565 2575 scope.go:117] "RemoveContainer" containerID="ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4" Jun 05 14:37:32.559906 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:37:32.559888 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4\": container with ID starting with ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4 not found: ID does not exist" containerID="ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4" Jun 05 14:37:32.559994 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.559919 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4"} err="failed to get container status \"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4\": rpc error: code = NotFound desc = could not find container \"ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4\": container with ID starting with ffb44242afb8f76ea5e2d9298dd0a30b9d0f5e9328a8b820e6725760152d3eb4 not found: ID does not exist" Jun 05 14:37:32.559994 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.559952 2575 scope.go:117] "RemoveContainer" containerID="96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba" Jun 05 14:37:32.566942 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.566918 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:37:32.569152 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.569130 2575 scope.go:117] "RemoveContainer" containerID="96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba" Jun 05 14:37:32.569461 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:37:32.569437 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba\": container with ID starting with 96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba not found: ID does not exist" containerID="96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba" Jun 05 14:37:32.569554 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.569465 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba"} err="failed to get container status \"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba\": rpc error: code = NotFound desc = could not find container \"96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba\": container with ID starting with 96d3f2ef81675d13135422a69d3d05e1b6005bcaa1efd2036245cfe7f80a15ba not found: ID does not exist" Jun 05 14:37:32.569724 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.569706 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-fdffq"] Jun 05 14:37:32.579298 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.579276 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:32.584672 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:32.584651 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6787df6784-h4942"] Jun 05 14:37:34.128663 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:34.128623 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0304b321-345b-4d6f-ac4c-240a1c44582a" path="/var/lib/kubelet/pods/0304b321-345b-4d6f-ac4c-240a1c44582a/volumes" Jun 05 14:37:34.129132 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:34.129111 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" path="/var/lib/kubelet/pods/8c49ec74-70f9-4748-ad22-ea6f1ad5a66f/volumes" Jun 05 14:37:38.892084 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:38.892035 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:37:38.985245 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:37:38.985190 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:09.920411 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:09.920373 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:10.085189 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:10.085149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:10.338259 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:10.338226 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:10.423334 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:10.423298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:18.782279 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.782240 2575 generic.go:356] "Generic (PLEG): container finished" podID="37b2efec-939a-4544-be80-6de06a2318bd" containerID="b178339147efcc29b0efbb959149ac14d87c44f58942c5a83b98e325a6872d77" exitCode=0 Jun 05 14:38:18.782793 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.782309 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" event={"ID":"37b2efec-939a-4544-be80-6de06a2318bd","Type":"ContainerDied","Data":"b178339147efcc29b0efbb959149ac14d87c44f58942c5a83b98e325a6872d77"} Jun 05 14:38:18.782865 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.782808 2575 scope.go:117] "RemoveContainer" containerID="b178339147efcc29b0efbb959149ac14d87c44f58942c5a83b98e325a6872d77" Jun 05 14:38:18.783873 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.783840 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:38:18.784000 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.783926 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:38:18.784000 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:18.783979 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 14:38:19.789462 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:19.789428 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" event={"ID":"37b2efec-939a-4544-be80-6de06a2318bd","Type":"ContainerStarted","Data":"301826c60436babffe997ab936fc732b22f92c52bf3be489e93fd907f8bf9b8f"} Jun 05 14:38:19.861913 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:19.861872 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:38:19.862236 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:19.862179 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-svksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 05 14:38:19.862317 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:19.862294 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" podUID="37b2efec-939a-4544-be80-6de06a2318bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 05 14:38:20.862054 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:20.862013 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-svksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 05 14:38:20.862492 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:20.862084 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" podUID="37b2efec-939a-4544-be80-6de06a2318bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 05 14:38:21.862965 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:21.862920 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-svksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 05 14:38:21.863500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:21.862996 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" podUID="37b2efec-939a-4544-be80-6de06a2318bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 05 14:38:22.861994 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:22.861954 2575 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-svksd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" start-of-body= Jun 05 14:38:22.862176 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:22.862017 2575 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" podUID="37b2efec-939a-4544-be80-6de06a2318bd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.37:15021/healthz/ready\": dial tcp 10.132.0.37:15021: connect: connection refused" Jun 05 14:38:23.865952 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:23.865921 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:38:23.866384 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:23.866307 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:38:23.867159 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:23.867139 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-svksd" Jun 05 14:38:30.506032 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:30.505998 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:30.560284 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:30.560236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:38:59.388137 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388099 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388520 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" containerName="authorino" Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388533 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" containerName="authorino" Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388542 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0304b321-345b-4d6f-ac4c-240a1c44582a" containerName="authorino" Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388547 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="0304b321-345b-4d6f-ac4c-240a1c44582a" containerName="authorino" Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388612 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="0304b321-345b-4d6f-ac4c-240a1c44582a" containerName="authorino" Jun 05 14:38:59.388636 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.388621 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c49ec74-70f9-4748-ad22-ea6f1ad5a66f" containerName="authorino" Jun 05 14:38:59.391731 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.391714 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.394276 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.394253 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 05 14:38:59.399617 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.399167 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:38:59.434377 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.434340 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.434553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.434388 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgbgd\" (UniqueName: \"kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.434553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.434448 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.535565 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.535526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgbgd\" (UniqueName: \"kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.535736 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.535591 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.535736 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.535640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.536361 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.536334 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.538033 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.538004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.545048 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.545019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgbgd\" (UniqueName: \"kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd\") pod \"authorino-5f6888f7fd-tl5jl\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.702421 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.702339 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:38:59.837629 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.837602 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:38:59.840068 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:38:59.840042 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfded819d_b1e8_4dce_a483_373c09c98d9a.slice/crio-29cd49020c138b92413fa50e58da31254ee5927959abcabec119f5115d12cd5c WatchSource:0}: Error finding container 29cd49020c138b92413fa50e58da31254ee5927959abcabec119f5115d12cd5c: Status 404 returned error can't find the container with id 29cd49020c138b92413fa50e58da31254ee5927959abcabec119f5115d12cd5c Jun 05 14:38:59.841352 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.841335 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:38:59.979597 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:38:59.979508 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" event={"ID":"fded819d-b1e8-4dce-a483-373c09c98d9a","Type":"ContainerStarted","Data":"29cd49020c138b92413fa50e58da31254ee5927959abcabec119f5115d12cd5c"} Jun 05 14:39:00.987779 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:00.987741 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" event={"ID":"fded819d-b1e8-4dce-a483-373c09c98d9a","Type":"ContainerStarted","Data":"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a"} Jun 05 14:39:01.004666 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.004613 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" podStartSLOduration=1.583393332 podStartE2EDuration="2.004597604s" totalImagesPullingTime="421.204272ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:38:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:39:01.001539625 +0000 UTC m=+1685.304322117" watchObservedRunningTime="2026-06-05 14:39:01.004597604 +0000 UTC m=+1685.307380096" Jun 05 14:39:01.026691 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.026657 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:39:01.026853 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.026829 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85d6f6767b-vbz64" podUID="b6df48db-3826-48fd-a21b-00b4a4c52654" containerName="authorino" containerID="cri-o://623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc" gracePeriod=30 Jun 05 14:39:01.294255 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.294230 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:39:01.351630 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.351595 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert\") pod \"b6df48db-3826-48fd-a21b-00b4a4c52654\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " Jun 05 14:39:01.351809 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.351660 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mv7v8\" (UniqueName: \"kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8\") pod \"b6df48db-3826-48fd-a21b-00b4a4c52654\" (UID: \"b6df48db-3826-48fd-a21b-00b4a4c52654\") " Jun 05 14:39:01.353649 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.353614 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8" (OuterVolumeSpecName: "kube-api-access-mv7v8") pod "b6df48db-3826-48fd-a21b-00b4a4c52654" (UID: "b6df48db-3826-48fd-a21b-00b4a4c52654"). InnerVolumeSpecName "kube-api-access-mv7v8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:39:01.362016 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.361989 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b6df48db-3826-48fd-a21b-00b4a4c52654" (UID: "b6df48db-3826-48fd-a21b-00b4a4c52654"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:39:01.452301 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.452267 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mv7v8\" (UniqueName: \"kubernetes.io/projected/b6df48db-3826-48fd-a21b-00b4a4c52654-kube-api-access-mv7v8\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:39:01.452301 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.452293 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b6df48db-3826-48fd-a21b-00b4a4c52654-tls-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:39:01.467767 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.467731 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:01.568161 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.568104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:01.994129 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.994093 2575 generic.go:356] "Generic (PLEG): container finished" podID="b6df48db-3826-48fd-a21b-00b4a4c52654" containerID="623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc" exitCode=0 Jun 05 14:39:01.994553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.994143 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85d6f6767b-vbz64" Jun 05 14:39:01.994553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.994183 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6f6767b-vbz64" event={"ID":"b6df48db-3826-48fd-a21b-00b4a4c52654","Type":"ContainerDied","Data":"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc"} Jun 05 14:39:01.994553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.994245 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85d6f6767b-vbz64" event={"ID":"b6df48db-3826-48fd-a21b-00b4a4c52654","Type":"ContainerDied","Data":"b6556ceff27889a486a963080d2dd7de36da22edbc33a0bda893f62262633ea5"} Jun 05 14:39:01.994553 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:01.994266 2575 scope.go:117] "RemoveContainer" containerID="623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc" Jun 05 14:39:02.002973 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:02.002957 2575 scope.go:117] "RemoveContainer" containerID="623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc" Jun 05 14:39:02.003279 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:39:02.003256 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc\": container with ID starting with 623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc not found: ID does not exist" containerID="623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc" Jun 05 14:39:02.003414 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:02.003285 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc"} err="failed to get container status \"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc\": rpc error: code = NotFound desc = could not find container \"623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc\": container with ID starting with 623553f9a1c9fa74b3be19acd17931218220208bf3fec03558b98804175babcc not found: ID does not exist" Jun 05 14:39:02.021733 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:02.021702 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:39:02.023367 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:02.023349 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85d6f6767b-vbz64"] Jun 05 14:39:02.128125 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:02.128086 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6df48db-3826-48fd-a21b-00b4a4c52654" path="/var/lib/kubelet/pods/b6df48db-3826-48fd-a21b-00b4a4c52654/volumes" Jun 05 14:39:15.965068 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:15.964978 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:16.022496 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:16.022458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:16.456818 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:16.456774 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:34.577075 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:34.577033 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:38.883427 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:38.883392 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:39:52.469077 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:39:52.469038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:40:00.570574 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:00.570535 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:40:18.038898 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:18.038851 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:40:21.263214 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:21.263164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:40:24.196774 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:24.196735 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:40:56.223845 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:56.223816 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:40:56.227593 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:56.227563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:40:56.233080 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:56.233061 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:40:56.243759 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:40:56.243739 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:41:02.542781 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:02.542736 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:41:12.129420 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.129383 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574465fb87-nv2cf"] Jun 05 14:41:12.129804 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.129771 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6df48db-3826-48fd-a21b-00b4a4c52654" containerName="authorino" Jun 05 14:41:12.129804 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.129783 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6df48db-3826-48fd-a21b-00b4a4c52654" containerName="authorino" Jun 05 14:41:12.129878 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.129842 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6df48db-3826-48fd-a21b-00b4a4c52654" containerName="authorino" Jun 05 14:41:12.132807 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.132786 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.141046 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.141017 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574465fb87-nv2cf"] Jun 05 14:41:12.245802 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.245762 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76ldd\" (UniqueName: \"kubernetes.io/projected/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-kube-api-access-76ldd\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.246002 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.245809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-oidc-ca\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.246002 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.245877 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-tls-cert\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.347221 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.347156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76ldd\" (UniqueName: \"kubernetes.io/projected/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-kube-api-access-76ldd\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.347221 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.347227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-oidc-ca\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.347439 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.347264 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-tls-cert\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.347981 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.347960 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-oidc-ca\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.349716 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.349697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-tls-cert\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.356180 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.356160 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76ldd\" (UniqueName: \"kubernetes.io/projected/ad9d33ac-97e8-4523-ba11-155eeb05c4c8-kube-api-access-76ldd\") pod \"authorino-574465fb87-nv2cf\" (UID: \"ad9d33ac-97e8-4523-ba11-155eeb05c4c8\") " pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.443062 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.442954 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574465fb87-nv2cf" Jun 05 14:41:12.579220 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.579177 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574465fb87-nv2cf"] Jun 05 14:41:12.581268 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:41:12.581232 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad9d33ac_97e8_4523_ba11_155eeb05c4c8.slice/crio-13655e9707270ae17138bcfa54a7f08275beae9a4e834518ddf669aa8d197bce WatchSource:0}: Error finding container 13655e9707270ae17138bcfa54a7f08275beae9a4e834518ddf669aa8d197bce: Status 404 returned error can't find the container with id 13655e9707270ae17138bcfa54a7f08275beae9a4e834518ddf669aa8d197bce Jun 05 14:41:12.635590 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.635558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574465fb87-nv2cf" event={"ID":"ad9d33ac-97e8-4523-ba11-155eeb05c4c8","Type":"ContainerStarted","Data":"13655e9707270ae17138bcfa54a7f08275beae9a4e834518ddf669aa8d197bce"} Jun 05 14:41:12.675859 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.675823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:41:12.776253 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:12.776150 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:41:13.645032 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.644997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574465fb87-nv2cf" event={"ID":"ad9d33ac-97e8-4523-ba11-155eeb05c4c8","Type":"ContainerStarted","Data":"7f17255b51a1a3d3ffd2906b2d6a14e08e00e93980ed183441af018a278b7e69"} Jun 05 14:41:13.661585 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.661531 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574465fb87-nv2cf" podStartSLOduration=1.186191938 podStartE2EDuration="1.661513138s" totalImagesPullingTime="475.3212ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:41:13.660700715 +0000 UTC m=+1817.963483208" watchObservedRunningTime="2026-06-05 14:41:13.661513138 +0000 UTC m=+1817.964295680" Jun 05 14:41:13.699221 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.698875 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:41:13.699221 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.699104 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" podUID="fded819d-b1e8-4dce-a483-373c09c98d9a" containerName="authorino" containerID="cri-o://775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a" gracePeriod=30 Jun 05 14:41:13.812506 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.812468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:41:13.910923 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.910844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:41:13.968237 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:13.968187 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:41:14.065064 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.065033 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert\") pod \"fded819d-b1e8-4dce-a483-373c09c98d9a\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " Jun 05 14:41:14.065295 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.065126 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca\") pod \"fded819d-b1e8-4dce-a483-373c09c98d9a\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " Jun 05 14:41:14.065295 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.065174 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vgbgd\" (UniqueName: \"kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd\") pod \"fded819d-b1e8-4dce-a483-373c09c98d9a\" (UID: \"fded819d-b1e8-4dce-a483-373c09c98d9a\") " Jun 05 14:41:14.067179 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.067153 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd" (OuterVolumeSpecName: "kube-api-access-vgbgd") pod "fded819d-b1e8-4dce-a483-373c09c98d9a" (UID: "fded819d-b1e8-4dce-a483-373c09c98d9a"). InnerVolumeSpecName "kube-api-access-vgbgd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:41:14.071366 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.071333 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "fded819d-b1e8-4dce-a483-373c09c98d9a" (UID: "fded819d-b1e8-4dce-a483-373c09c98d9a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 14:41:14.075441 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.075419 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fded819d-b1e8-4dce-a483-373c09c98d9a" (UID: "fded819d-b1e8-4dce-a483-373c09c98d9a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 14:41:14.166177 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.166072 2575 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/fded819d-b1e8-4dce-a483-373c09c98d9a-oidc-ca\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:41:14.166177 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.166126 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vgbgd\" (UniqueName: \"kubernetes.io/projected/fded819d-b1e8-4dce-a483-373c09c98d9a-kube-api-access-vgbgd\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:41:14.166177 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.166141 2575 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fded819d-b1e8-4dce-a483-373c09c98d9a-tls-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:41:14.652385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.652339 2575 generic.go:356] "Generic (PLEG): container finished" podID="fded819d-b1e8-4dce-a483-373c09c98d9a" containerID="775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a" exitCode=0 Jun 05 14:41:14.652385 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.652381 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" Jun 05 14:41:14.652964 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.652439 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" event={"ID":"fded819d-b1e8-4dce-a483-373c09c98d9a","Type":"ContainerDied","Data":"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a"} Jun 05 14:41:14.652964 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.652505 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f6888f7fd-tl5jl" event={"ID":"fded819d-b1e8-4dce-a483-373c09c98d9a","Type":"ContainerDied","Data":"29cd49020c138b92413fa50e58da31254ee5927959abcabec119f5115d12cd5c"} Jun 05 14:41:14.652964 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.652531 2575 scope.go:117] "RemoveContainer" containerID="775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a" Jun 05 14:41:14.662080 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.662056 2575 scope.go:117] "RemoveContainer" containerID="775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a" Jun 05 14:41:14.662349 ip-10-0-141-39 kubenswrapper[2575]: E0605 14:41:14.662331 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a\": container with ID starting with 775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a not found: ID does not exist" containerID="775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a" Jun 05 14:41:14.662416 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.662357 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a"} err="failed to get container status \"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a\": rpc error: code = NotFound desc = could not find container \"775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a\": container with ID starting with 775dbcf673944ab5debf939b11eaa7bfefdf5158d3e856d3f376dff1244cd55a not found: ID does not exist" Jun 05 14:41:14.669138 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.669113 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:41:14.672803 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:14.672783 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f6888f7fd-tl5jl"] Jun 05 14:41:16.128007 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:41:16.127962 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fded819d-b1e8-4dce-a483-373c09c98d9a" path="/var/lib/kubelet/pods/fded819d-b1e8-4dce-a483-373c09c98d9a/volumes" Jun 05 14:43:21.093879 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:21.093839 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:22.416795 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:22.416752 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:26.411617 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:26.411586 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:26.512465 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:26.512433 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:29.431036 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:29.430999 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:35.068094 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:35.068055 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:43:35.167958 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:43:35.167922 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:07.202858 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:07.202770 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:07.301510 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:07.301475 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:32.462121 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:32.462086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:38.067285 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:38.067244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:38.169741 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:38.169704 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:38.270432 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:38.270395 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:38.471789 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:38.471690 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:38.566074 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:38.566039 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:55.042944 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:55.042909 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:55.153744 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:55.153708 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:44:55.262761 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:44:55.262721 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:00.134434 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.134397 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29677845-7l67q"] Jun 05 14:45:00.134941 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.134919 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fded819d-b1e8-4dce-a483-373c09c98d9a" containerName="authorino" Jun 05 14:45:00.135021 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.134944 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="fded819d-b1e8-4dce-a483-373c09c98d9a" containerName="authorino" Jun 05 14:45:00.135083 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.135070 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="fded819d-b1e8-4dce-a483-373c09c98d9a" containerName="authorino" Jun 05 14:45:00.138170 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.138149 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:00.140645 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.140628 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-b6t69\"" Jun 05 14:45:00.156344 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.156318 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29677845-7l67q"] Jun 05 14:45:00.282909 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.282852 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdbfj\" (UniqueName: \"kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj\") pod \"maas-api-key-cleanup-29677845-7l67q\" (UID: \"845b9821-2900-4580-b2bc-92c4c1dd3611\") " pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:00.384270 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.384228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdbfj\" (UniqueName: \"kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj\") pod \"maas-api-key-cleanup-29677845-7l67q\" (UID: \"845b9821-2900-4580-b2bc-92c4c1dd3611\") " pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:00.393420 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.393342 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdbfj\" (UniqueName: \"kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj\") pod \"maas-api-key-cleanup-29677845-7l67q\" (UID: \"845b9821-2900-4580-b2bc-92c4c1dd3611\") " pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:00.452430 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.452387 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:00.589554 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.589521 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29677845-7l67q"] Jun 05 14:45:00.591272 ip-10-0-141-39 kubenswrapper[2575]: W0605 14:45:00.591248 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod845b9821_2900_4580_b2bc_92c4c1dd3611.slice/crio-37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96 WatchSource:0}: Error finding container 37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96: Status 404 returned error can't find the container with id 37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96 Jun 05 14:45:00.593140 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.593120 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 14:45:00.747518 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.747422 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" event={"ID":"845b9821-2900-4580-b2bc-92c4c1dd3611","Type":"ContainerStarted","Data":"37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96"} Jun 05 14:45:00.789109 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.789076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:00.845561 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:00.845528 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:03.765816 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:03.765717 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" event={"ID":"845b9821-2900-4580-b2bc-92c4c1dd3611","Type":"ContainerStarted","Data":"24ddf50c841e18dd008a2ea6bf962bf69d4fc2fa4f30dcb582a054e0e694e731"} Jun 05 14:45:03.781766 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:03.781719 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" podStartSLOduration=1.30156145 podStartE2EDuration="3.781701229s" totalImagesPullingTime="2.480139779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 14:45:03.780721566 +0000 UTC m=+2048.083504069" watchObservedRunningTime="2026-06-05 14:45:03.781701229 +0000 UTC m=+2048.084483721" Jun 05 14:45:04.772106 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:04.772072 2575 generic.go:356] "Generic (PLEG): container finished" podID="845b9821-2900-4580-b2bc-92c4c1dd3611" containerID="24ddf50c841e18dd008a2ea6bf962bf69d4fc2fa4f30dcb582a054e0e694e731" exitCode=0 Jun 05 14:45:04.772500 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:04.772132 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" event={"ID":"845b9821-2900-4580-b2bc-92c4c1dd3611","Type":"ContainerDied","Data":"24ddf50c841e18dd008a2ea6bf962bf69d4fc2fa4f30dcb582a054e0e694e731"} Jun 05 14:45:05.915143 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:05.915117 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:06.033766 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.033680 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdbfj\" (UniqueName: \"kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj\") pod \"845b9821-2900-4580-b2bc-92c4c1dd3611\" (UID: \"845b9821-2900-4580-b2bc-92c4c1dd3611\") " Jun 05 14:45:06.035862 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.035836 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj" (OuterVolumeSpecName: "kube-api-access-zdbfj") pod "845b9821-2900-4580-b2bc-92c4c1dd3611" (UID: "845b9821-2900-4580-b2bc-92c4c1dd3611"). InnerVolumeSpecName "kube-api-access-zdbfj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 14:45:06.135167 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.135127 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdbfj\" (UniqueName: \"kubernetes.io/projected/845b9821-2900-4580-b2bc-92c4c1dd3611-kube-api-access-zdbfj\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 14:45:06.782957 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.782926 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" Jun 05 14:45:06.783171 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.782927 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677845-7l67q" event={"ID":"845b9821-2900-4580-b2bc-92c4c1dd3611","Type":"ContainerDied","Data":"37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96"} Jun 05 14:45:06.783171 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:06.783076 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="37cf392990112828cceca0b6f83f21353d9ae858a78d290f2945960b10264a96" Jun 05 14:45:08.924632 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:08.924599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:09.037678 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:09.037640 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:09.154991 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:09.154953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:09.255333 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:09.255246 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:25.674681 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:25.674648 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:25.785876 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:25.785838 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:25.909451 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:25.909419 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:31.424234 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:31.424179 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:31.481802 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:31.481771 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:45:56.260249 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:56.260220 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:45:56.267788 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:56.267760 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:45:56.270954 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:56.270931 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:45:56.277795 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:45:56.277774 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:46:22.293713 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:46:22.293675 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:48:53.613712 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:48:53.613667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:48:54.642285 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:48:54.642253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:50:14.776861 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:50:14.776824 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:50:56.295324 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:50:56.295293 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:50:56.302980 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:50:56.302959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:50:56.304870 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:50:56.304847 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:50:56.311513 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:50:56.311493 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:51:14.975135 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:51:14.975041 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:51:15.076458 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:51:15.076415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:51:48.714746 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:51:48.714696 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:55:56.326406 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:55:56.326327 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:55:56.334857 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:55:56.334835 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:55:56.335142 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:55:56.335124 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 14:55:56.343468 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:55:56.343451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 14:56:39.626998 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:56:39.626965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:58:34.157544 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:58:34.157499 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:58:34.245215 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:58:34.245170 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 14:59:23.033738 ip-10-0-141-39 kubenswrapper[2575]: I0605 14:59:23.033678 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:00:00.137371 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.137339 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29677860-cb5k4"] Jun 05 15:00:00.139786 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.137748 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="845b9821-2900-4580-b2bc-92c4c1dd3611" containerName="cleanup" Jun 05 15:00:00.139786 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.137761 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="845b9821-2900-4580-b2bc-92c4c1dd3611" containerName="cleanup" Jun 05 15:00:00.139786 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.137836 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="845b9821-2900-4580-b2bc-92c4c1dd3611" containerName="cleanup" Jun 05 15:00:00.140948 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.140932 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:00.143393 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.143371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-b6t69\"" Jun 05 15:00:00.159220 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.158177 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29677860-cb5k4"] Jun 05 15:00:00.191739 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.191682 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g68lc\" (UniqueName: \"kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc\") pod \"maas-api-key-cleanup-29677860-cb5k4\" (UID: \"38dae246-ce54-47a7-bd0a-1c28c25b314c\") " pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:00.292699 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.292666 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g68lc\" (UniqueName: \"kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc\") pod \"maas-api-key-cleanup-29677860-cb5k4\" (UID: \"38dae246-ce54-47a7-bd0a-1c28c25b314c\") " pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:00.304350 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.304317 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g68lc\" (UniqueName: \"kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc\") pod \"maas-api-key-cleanup-29677860-cb5k4\" (UID: \"38dae246-ce54-47a7-bd0a-1c28c25b314c\") " pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:00.451159 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.451047 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:00.585555 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:00.585501 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29677860-cb5k4"] Jun 05 15:00:00.588060 ip-10-0-141-39 kubenswrapper[2575]: W0605 15:00:00.588028 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38dae246_ce54_47a7_bd0a_1c28c25b314c.slice/crio-5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059 WatchSource:0}: Error finding container 5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059: Status 404 returned error can't find the container with id 5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059 Jun 05 15:00:01.174826 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:01.174791 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" event={"ID":"38dae246-ce54-47a7-bd0a-1c28c25b314c","Type":"ContainerStarted","Data":"c94196b26f16bd794e47ae531f31694d9228e880247ff16a8cd1c29deb81b718"} Jun 05 15:00:01.175188 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:01.174841 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" event={"ID":"38dae246-ce54-47a7-bd0a-1c28c25b314c","Type":"ContainerStarted","Data":"5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059"} Jun 05 15:00:01.190071 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:01.190023 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" podStartSLOduration=1.190010765 podStartE2EDuration="1.190010765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:00:01.188876189 +0000 UTC m=+2945.491658681" watchObservedRunningTime="2026-06-05 15:00:01.190010765 +0000 UTC m=+2945.492793258" Jun 05 15:00:02.181221 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:02.181168 2575 generic.go:356] "Generic (PLEG): container finished" podID="38dae246-ce54-47a7-bd0a-1c28c25b314c" containerID="c94196b26f16bd794e47ae531f31694d9228e880247ff16a8cd1c29deb81b718" exitCode=0 Jun 05 15:00:02.181620 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:02.181253 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" event={"ID":"38dae246-ce54-47a7-bd0a-1c28c25b314c","Type":"ContainerDied","Data":"c94196b26f16bd794e47ae531f31694d9228e880247ff16a8cd1c29deb81b718"} Jun 05 15:00:03.325510 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:03.325485 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:03.419152 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:03.419119 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g68lc\" (UniqueName: \"kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc\") pod \"38dae246-ce54-47a7-bd0a-1c28c25b314c\" (UID: \"38dae246-ce54-47a7-bd0a-1c28c25b314c\") " Jun 05 15:00:03.421338 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:03.421306 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc" (OuterVolumeSpecName: "kube-api-access-g68lc") pod "38dae246-ce54-47a7-bd0a-1c28c25b314c" (UID: "38dae246-ce54-47a7-bd0a-1c28c25b314c"). InnerVolumeSpecName "kube-api-access-g68lc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:00:03.520568 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:03.520479 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g68lc\" (UniqueName: \"kubernetes.io/projected/38dae246-ce54-47a7-bd0a-1c28c25b314c-kube-api-access-g68lc\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:00:04.192597 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:04.192565 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" Jun 05 15:00:04.192775 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:04.192613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29677860-cb5k4" event={"ID":"38dae246-ce54-47a7-bd0a-1c28c25b314c","Type":"ContainerDied","Data":"5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059"} Jun 05 15:00:04.192775 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:04.192659 2575 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c26cefdbef467de4e5f55961a78d02834186c8b648b8721ccfa06abac2dd059" Jun 05 15:00:56.360157 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:56.360129 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 15:00:56.368284 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:56.368261 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 15:00:56.368462 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:56.368444 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 15:00:56.376085 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:00:56.376066 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xl795_46da1f68-eb61-4a3e-9362-aa423cd81ce8/ovn-acl-logging/0.log" Jun 05 15:02:22.807635 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:02:22.807601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:02:23.897724 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:02:23.897637 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:02:49.160854 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:02:49.160812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:02:54.568224 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:02:54.568145 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:18.839071 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:18.838966 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:31.998099 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:31.998046 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:34.054702 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.054662 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:34.055189 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.055142 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38dae246-ce54-47a7-bd0a-1c28c25b314c" containerName="cleanup" Jun 05 15:03:34.055189 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.055158 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="38dae246-ce54-47a7-bd0a-1c28c25b314c" containerName="cleanup" Jun 05 15:03:34.055320 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.055258 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="38dae246-ce54-47a7-bd0a-1c28c25b314c" containerName="cleanup" Jun 05 15:03:34.058379 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.058309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.061135 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.061110 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ff1f5242-openshift-default-dockercfg-7c442\"" Jun 05 15:03:34.082553 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.082508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:34.090846 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.090803 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:34.155278 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155460 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155287 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155506 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155446 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155506 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155485 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155575 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155539 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155575 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155566 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155646 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155646 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155629 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.155714 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.155675 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpn2q\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.184355 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.184320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:34.256150 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256150 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256148 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256402 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256402 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256229 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256402 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256253 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256402 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256365 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256602 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256428 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpn2q\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256602 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256602 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256823 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256641 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256971 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256923 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.256971 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256951 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.257149 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.256955 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.257414 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.257381 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.258720 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.258697 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.259054 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.259038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.265822 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.265793 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpn2q\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.267046 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.267028 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token\") pod \"e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.305761 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.305667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:34.369741 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.369702 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:34.397936 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.397902 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:34.515187 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.515157 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:34.517159 ip-10-0-141-39 kubenswrapper[2575]: W0605 15:03:34.517132 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05e007d_e44a_414b_adec_c670680ff805.slice/crio-d7f65039f147635eb0a327817f567d4b94e6dadaf37c32546d30d03e1090b30a WatchSource:0}: Error finding container d7f65039f147635eb0a327817f567d4b94e6dadaf37c32546d30d03e1090b30a: Status 404 returned error can't find the container with id d7f65039f147635eb0a327817f567d4b94e6dadaf37c32546d30d03e1090b30a Jun 05 15:03:34.519352 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.519320 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:34.519468 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.519398 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:34.519468 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:34.519445 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:35.254396 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:35.254356 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" event={"ID":"c05e007d-e44a-414b-adec-c670680ff805","Type":"ContainerStarted","Data":"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6"} Jun 05 15:03:35.254815 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:35.254418 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" event={"ID":"c05e007d-e44a-414b-adec-c670680ff805","Type":"ContainerStarted","Data":"d7f65039f147635eb0a327817f567d4b94e6dadaf37c32546d30d03e1090b30a"} Jun 05 15:03:35.280690 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:35.280640 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" podStartSLOduration=1.2806247929999999 podStartE2EDuration="1.280624793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:03:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:03:35.279362831 +0000 UTC m=+3159.582145325" watchObservedRunningTime="2026-06-05 15:03:35.280624793 +0000 UTC m=+3159.583407286" Jun 05 15:03:35.370182 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:35.370149 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:35.375392 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:35.375366 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:36.259031 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:36.259000 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:36.260109 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:36.260090 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:37.658549 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:37.658505 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:40.552764 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:40.552726 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:40.728974 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:40.728939 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:40.729187 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:40.729159 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" podUID="c05e007d-e44a-414b-adec-c670680ff805" containerName="istio-proxy" containerID="cri-o://c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6" gracePeriod=30 Jun 05 15:03:40.758500 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:40.758465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:40.859255 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:40.859188 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:42.769420 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:42.769383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:45.988869 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:45.988807 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:46.068778 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068740 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.068778 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068786 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068805 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068827 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mpn2q\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068882 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068914 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068948 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.068979 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069030 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket\") pod \"c05e007d-e44a-414b-adec-c670680ff805\" (UID: \"c05e007d-e44a-414b-adec-c670680ff805\") " Jun 05 15:03:46.069436 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069186 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:46.069436 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069350 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-credential-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.069436 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069415 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:03:46.069594 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069438 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:46.069594 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069559 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data" (OuterVolumeSpecName: "istio-data") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:46.069694 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.069635 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:46.071649 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.071619 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 15:03:46.071649 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.071635 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:46.071770 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.071640 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q" (OuterVolumeSpecName: "kube-api-access-mpn2q") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "kube-api-access-mpn2q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:03:46.071770 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.071657 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token" (OuterVolumeSpecName: "istio-token") pod "c05e007d-e44a-414b-adec-c670680ff805" (UID: "c05e007d-e44a-414b-adec-c670680ff805"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:03:46.170791 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170758 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-istio-token\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.170791 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170787 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c05e007d-e44a-414b-adec-c670680ff805-istio-podinfo\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.170791 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170796 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mpn2q\" (UniqueName: \"kubernetes.io/projected/c05e007d-e44a-414b-adec-c670680ff805-kube-api-access-mpn2q\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.171027 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170806 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c05e007d-e44a-414b-adec-c670680ff805-istiod-ca-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.171027 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170815 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-envoy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.171027 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170822 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-istio-data\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.171027 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170829 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.171027 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.170836 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c05e007d-e44a-414b-adec-c670680ff805-workload-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:46.310709 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.310622 2575 generic.go:356] "Generic (PLEG): container finished" podID="c05e007d-e44a-414b-adec-c670680ff805" containerID="c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6" exitCode=0 Jun 05 15:03:46.310709 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.310667 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" Jun 05 15:03:46.310894 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.310705 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" event={"ID":"c05e007d-e44a-414b-adec-c670680ff805","Type":"ContainerDied","Data":"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6"} Jun 05 15:03:46.310894 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.310756 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm" event={"ID":"c05e007d-e44a-414b-adec-c670680ff805","Type":"ContainerDied","Data":"d7f65039f147635eb0a327817f567d4b94e6dadaf37c32546d30d03e1090b30a"} Jun 05 15:03:46.310894 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.310778 2575 scope.go:117] "RemoveContainer" containerID="c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6" Jun 05 15:03:46.320116 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.320098 2575 scope.go:117] "RemoveContainer" containerID="c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6" Jun 05 15:03:46.320476 ip-10-0-141-39 kubenswrapper[2575]: E0605 15:03:46.320456 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6\": container with ID starting with c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6 not found: ID does not exist" containerID="c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6" Jun 05 15:03:46.320521 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.320489 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6"} err="failed to get container status \"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6\": rpc error: code = NotFound desc = could not find container \"c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6\": container with ID starting with c56ccdd0c75e1b980eb38203a36230201a40d4cccbbf3f855bff926479bcf8d6 not found: ID does not exist" Jun 05 15:03:46.329086 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.329060 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:46.333361 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.333338 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ff1f5242-openshift-default-c857b5f94-2jwlm"] Jun 05 15:03:46.526764 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.526727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:46.632380 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.632338 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:46.692413 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.692382 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:03:46.692783 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.692762 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05e007d-e44a-414b-adec-c670680ff805" containerName="istio-proxy" Jun 05 15:03:46.692783 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.692777 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05e007d-e44a-414b-adec-c670680ff805" containerName="istio-proxy" Jun 05 15:03:46.692969 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.692845 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05e007d-e44a-414b-adec-c670680ff805" containerName="istio-proxy" Jun 05 15:03:46.697567 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.697543 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.701421 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.701395 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-76fd6952-openshift-default-dockercfg-46dlq\"" Jun 05 15:03:46.710178 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.710156 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:03:46.729075 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.729045 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:46.776957 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.776925 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777126 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.776977 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv5rz\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777126 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.776999 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777126 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777126 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777294 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777141 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777294 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777212 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777294 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777239 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.777294 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.777266 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.829751 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.829714 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:46.878046 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878017 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878231 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878055 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878285 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878226 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878285 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878361 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878293 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878407 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878360 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878465 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878422 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv5rz\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878575 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878545 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878647 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878647 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878623 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.878647 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.878640 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.879050 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.879022 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.879180 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.879102 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.879180 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.879100 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.880997 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.880973 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.881263 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.881243 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.887097 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.887040 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.887373 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.887353 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv5rz\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz\") pod \"e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:46.929158 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:46.929121 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:47.010415 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.010381 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:47.032257 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.032219 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:47.167579 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.167547 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:03:47.170601 ip-10-0-141-39 kubenswrapper[2575]: W0605 15:03:47.170571 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc83725f_2986_4ed0_af11_01e343abb1d1.slice/crio-a2195fbe3a89bc0e6bbb0282d8263003e249fdff86afc74fdd303016e7bc2b05 WatchSource:0}: Error finding container a2195fbe3a89bc0e6bbb0282d8263003e249fdff86afc74fdd303016e7bc2b05: Status 404 returned error can't find the container with id a2195fbe3a89bc0e6bbb0282d8263003e249fdff86afc74fdd303016e7bc2b05 Jun 05 15:03:47.172806 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.172774 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:47.172910 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.172834 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:47.172910 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.172862 2575 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 05 15:03:47.318272 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.318233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" event={"ID":"bc83725f-2986-4ed0-af11-01e343abb1d1","Type":"ContainerStarted","Data":"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a"} Jun 05 15:03:47.318466 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.318325 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" event={"ID":"bc83725f-2986-4ed0-af11-01e343abb1d1","Type":"ContainerStarted","Data":"a2195fbe3a89bc0e6bbb0282d8263003e249fdff86afc74fdd303016e7bc2b05"} Jun 05 15:03:47.338419 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:47.338355 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" podStartSLOduration=1.338332848 podStartE2EDuration="1.338332848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:03:47.337916529 +0000 UTC m=+3171.640699025" watchObservedRunningTime="2026-06-05 15:03:47.338332848 +0000 UTC m=+3171.641115341" Jun 05 15:03:48.011411 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:48.011376 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:48.016767 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:48.016740 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:48.127588 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:48.127555 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05e007d-e44a-414b-adec-c670680ff805" path="/var/lib/kubelet/pods/c05e007d-e44a-414b-adec-c670680ff805/volumes" Jun 05 15:03:48.324542 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:48.324516 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:48.325545 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:48.325522 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:50.105018 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:50.104975 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:53.046904 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:53.046866 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:54.351947 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:54.351912 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:03:54.352417 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:54.352114 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" podUID="bc83725f-2986-4ed0-af11-01e343abb1d1" containerName="istio-proxy" containerID="cri-o://b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a" gracePeriod=30 Jun 05 15:03:54.372371 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:54.372337 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:54.472087 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:54.472052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:57.674308 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:57.672483 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:03:59.608569 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.608542 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:03:59.701442 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701340 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701442 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701388 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701442 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701438 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701454 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701469 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701509 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701537 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv5rz\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701556 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.701773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701617 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs\") pod \"bc83725f-2986-4ed0-af11-01e343abb1d1\" (UID: \"bc83725f-2986-4ed0-af11-01e343abb1d1\") " Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701762 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701787 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data" (OuterVolumeSpecName: "istio-data") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.701891 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.702008 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.702058 2575 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-credential-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.702078 2575 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-data\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.702093 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.702093 2575 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-socket\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.702467 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.702032 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 15:03:59.703891 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.703865 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 05 15:03:59.703891 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.703872 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz" (OuterVolumeSpecName: "kube-api-access-pv5rz") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "kube-api-access-pv5rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:03:59.704327 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.704304 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 15:03:59.704327 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.704313 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token" (OuterVolumeSpecName: "istio-token") pod "bc83725f-2986-4ed0-af11-01e343abb1d1" (UID: "bc83725f-2986-4ed0-af11-01e343abb1d1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 15:03:59.802632 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802591 2575 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-envoy\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.802632 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802623 2575 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc83725f-2986-4ed0-af11-01e343abb1d1-workload-certs\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.802632 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802632 2575 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-podinfo\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.802632 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802641 2575 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc83725f-2986-4ed0-af11-01e343abb1d1-istiod-ca-cert\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.802907 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802649 2575 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-istio-token\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:03:59.802907 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:03:59.802657 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv5rz\" (UniqueName: \"kubernetes.io/projected/bc83725f-2986-4ed0-af11-01e343abb1d1-kube-api-access-pv5rz\") on node \"ip-10-0-141-39.ec2.internal\" DevicePath \"\"" Jun 05 15:04:00.299935 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.299892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:04:00.383884 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.383848 2575 generic.go:356] "Generic (PLEG): container finished" podID="bc83725f-2986-4ed0-af11-01e343abb1d1" containerID="b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a" exitCode=0 Jun 05 15:04:00.384070 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.383893 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" Jun 05 15:04:00.384070 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.383937 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" event={"ID":"bc83725f-2986-4ed0-af11-01e343abb1d1","Type":"ContainerDied","Data":"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a"} Jun 05 15:04:00.384070 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.383993 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx" event={"ID":"bc83725f-2986-4ed0-af11-01e343abb1d1","Type":"ContainerDied","Data":"a2195fbe3a89bc0e6bbb0282d8263003e249fdff86afc74fdd303016e7bc2b05"} Jun 05 15:04:00.384070 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.384015 2575 scope.go:117] "RemoveContainer" containerID="b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a" Jun 05 15:04:00.393532 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.393514 2575 scope.go:117] "RemoveContainer" containerID="b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a" Jun 05 15:04:00.393832 ip-10-0-141-39 kubenswrapper[2575]: E0605 15:04:00.393808 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a\": container with ID starting with b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a not found: ID does not exist" containerID="b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a" Jun 05 15:04:00.393881 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.393840 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a"} err="failed to get container status \"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a\": rpc error: code = NotFound desc = could not find container \"b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a\": container with ID starting with b39a26d68fb68a76488d8cae3fd28bbc7ee97b4bad5d2370d15e587c4de79a7a not found: ID does not exist" Jun 05 15:04:00.396189 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.396167 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:04:00.403584 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.403562 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:04:00.407803 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:00.407781 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-76fd6952-openshift-default-567f8f5848-kdsvx"] Jun 05 15:04:02.130274 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:02.130233 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc83725f-2986-4ed0-af11-01e343abb1d1" path="/var/lib/kubelet/pods/bc83725f-2986-4ed0-af11-01e343abb1d1/volumes" Jun 05 15:04:06.656041 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:06.656002 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574465fb87-nv2cf_ad9d33ac-97e8-4523-ba11-155eeb05c4c8/authorino/0.log" Jun 05 15:04:11.381375 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:11.381343 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-77985dbbcc-x7wt9_f915661d-4819-4817-9a19-3bc5c964baf8/nginx/0.log" Jun 05 15:04:11.857977 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:11.857942 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29677845-7l67q_845b9821-2900-4580-b2bc-92c4c1dd3611/cleanup/0.log" Jun 05 15:04:11.968235 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:11.968209 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29677860-cb5k4_38dae246-ce54-47a7-bd0a-1c28c25b314c/cleanup/0.log" Jun 05 15:04:12.660727 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:12.660694 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649f7d5648-xm9v9_d7d18f7a-a830-463c-91bc-52b34c76c08d/copy-manifests/0.log" Jun 05 15:04:12.681829 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:12.681780 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649f7d5648-xm9v9_d7d18f7a-a830-463c-91bc-52b34c76c08d/manager/0.log" Jun 05 15:04:14.128773 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:14.128744 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574465fb87-nv2cf_ad9d33ac-97e8-4523-ba11-155eeb05c4c8/authorino/0.log" Jun 05 15:04:14.290721 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:14.290692 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-l7b67_c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817/manager/0.log" Jun 05 15:04:14.433270 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:14.433162 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vx558_c8a5820e-f89c-4764-a8a5-02367bc8e45a/manager/0.log" Jun 05 15:04:14.697192 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:14.697093 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sw5bd_124a126d-08f4-4a6b-878f-b83980ae5797/registry-server/0.log" Jun 05 15:04:15.075488 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:15.075458 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7v5pd_5750a555-7a23-4319-8d0b-2d1937183276/manager/0.log" Jun 05 15:04:15.435441 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:15.435358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qvd8r_c49182eb-4247-4afc-ac96-5e5a0cc5069d/istio-proxy/0.log" Jun 05 15:04:15.891540 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:15.891502 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/1.log" Jun 05 15:04:16.253889 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:16.253803 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cdc78777f-kkqpt_bcca4fde-001e-4fbb-a070-57978e55379e/router/0.log" Jun 05 15:04:21.614816 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.614777 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l5npr/must-gather-lzlsn"] Jun 05 15:04:21.615327 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.615142 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc83725f-2986-4ed0-af11-01e343abb1d1" containerName="istio-proxy" Jun 05 15:04:21.615327 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.615153 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc83725f-2986-4ed0-af11-01e343abb1d1" containerName="istio-proxy" Jun 05 15:04:21.615327 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.615260 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc83725f-2986-4ed0-af11-01e343abb1d1" containerName="istio-proxy" Jun 05 15:04:21.620382 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.620357 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.623765 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.623746 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l5npr\"/\"kube-root-ca.crt\"" Jun 05 15:04:21.624918 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.624891 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-l5npr\"/\"openshift-service-ca.crt\"" Jun 05 15:04:21.625040 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.624891 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-l5npr\"/\"default-dockercfg-62lrc\"" Jun 05 15:04:21.628319 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.628294 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l5npr/must-gather-lzlsn"] Jun 05 15:04:21.629635 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.629607 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:04:21.697188 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.697136 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8372aacc-4847-4a75-9658-e093445ae445-must-gather-output\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.697399 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.697319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwgck\" (UniqueName: \"kubernetes.io/projected/8372aacc-4847-4a75-9658-e093445ae445-kube-api-access-jwgck\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.727194 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.727160 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" limit=1024 Jun 05 15:04:21.798538 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.798501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8372aacc-4847-4a75-9658-e093445ae445-must-gather-output\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.798722 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.798578 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwgck\" (UniqueName: \"kubernetes.io/projected/8372aacc-4847-4a75-9658-e093445ae445-kube-api-access-jwgck\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.798914 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.798894 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8372aacc-4847-4a75-9658-e093445ae445-must-gather-output\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.807562 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.807539 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwgck\" (UniqueName: \"kubernetes.io/projected/8372aacc-4847-4a75-9658-e093445ae445-kube-api-access-jwgck\") pod \"must-gather-lzlsn\" (UID: \"8372aacc-4847-4a75-9658-e093445ae445\") " pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:21.930952 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:21.930852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l5npr/must-gather-lzlsn" Jun 05 15:04:22.063563 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:22.063538 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l5npr/must-gather-lzlsn"] Jun 05 15:04:22.065960 ip-10-0-141-39 kubenswrapper[2575]: W0605 15:04:22.065930 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8372aacc_4847_4a75_9658_e093445ae445.slice/crio-22515779632ef9cdc6c1ae9f0c99202fc0bf7c70d53c85eba0292cdedd752633 WatchSource:0}: Error finding container 22515779632ef9cdc6c1ae9f0c99202fc0bf7c70d53c85eba0292cdedd752633: Status 404 returned error can't find the container with id 22515779632ef9cdc6c1ae9f0c99202fc0bf7c70d53c85eba0292cdedd752633 Jun 05 15:04:22.067892 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:22.067876 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 15:04:22.493391 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:22.493358 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l5npr/must-gather-lzlsn" event={"ID":"8372aacc-4847-4a75-9658-e093445ae445","Type":"ContainerStarted","Data":"22515779632ef9cdc6c1ae9f0c99202fc0bf7c70d53c85eba0292cdedd752633"} Jun 05 15:04:23.500954 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:23.500916 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l5npr/must-gather-lzlsn" event={"ID":"8372aacc-4847-4a75-9658-e093445ae445","Type":"ContainerStarted","Data":"7e6b98cd106b64048903ce4f0ba12c68f0c80be732f2647f12ac00b336403806"} Jun 05 15:04:23.501379 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:23.500969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l5npr/must-gather-lzlsn" event={"ID":"8372aacc-4847-4a75-9658-e093445ae445","Type":"ContainerStarted","Data":"3cf3bbbf7d839e3497b7b093d4db8bd3d31299e9727f3f95bb3ceceec1e8feec"} Jun 05 15:04:23.519084 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:23.519010 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l5npr/must-gather-lzlsn" podStartSLOduration=1.614751841 podStartE2EDuration="2.518987422s" totalImagesPullingTime="904.235581ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 15:04:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:04:23.516027791 +0000 UTC m=+3207.818810286" watchObservedRunningTime="2026-06-05 15:04:23.518987422 +0000 UTC m=+3207.821769916" Jun 05 15:04:24.893910 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:24.893879 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jsrrq_ccbf197b-a176-4924-9ae5-35874a6c456a/global-pull-secret-syncer/0.log" Jun 05 15:04:24.968592 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:24.968557 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c9s84_f69c71f3-39de-44ba-880f-95f042bf0e23/konnectivity-agent/0.log" Jun 05 15:04:25.166967 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:25.166884 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-39.ec2.internal_b5cf065bc1451597f31ffcaf868f9a3f/haproxy/0.log" Jun 05 15:04:30.719245 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:30.717555 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574465fb87-nv2cf_ad9d33ac-97e8-4523-ba11-155eeb05c4c8/authorino/0.log" Jun 05 15:04:30.758479 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:30.758408 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-l7b67_c8f6aaa3-5ddb-45d9-866e-f8a0cd2ef817/manager/0.log" Jun 05 15:04:30.797283 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:30.797230 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-vx558_c8a5820e-f89c-4764-a8a5-02367bc8e45a/manager/0.log" Jun 05 15:04:30.876666 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:30.876629 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-sw5bd_124a126d-08f4-4a6b-878f-b83980ae5797/registry-server/0.log" Jun 05 15:04:31.077279 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:31.077240 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-7v5pd_5750a555-7a23-4319-8d0b-2d1937183276/manager/0.log" Jun 05 15:04:32.803994 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:32.803959 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-dw8cp_ca78d1d5-ddb9-445e-9f37-be8a73a03577/cluster-monitoring-operator/0.log" Jun 05 15:04:32.840664 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:32.840628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2p9mx_8faef627-d4ce-45f1-9325-c910a6c3c274/kube-state-metrics/0.log" Jun 05 15:04:32.863194 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:32.863160 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2p9mx_8faef627-d4ce-45f1-9325-c910a6c3c274/kube-rbac-proxy-main/0.log" Jun 05 15:04:32.897396 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:32.897308 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-2p9mx_8faef627-d4ce-45f1-9325-c910a6c3c274/kube-rbac-proxy-self/0.log" Jun 05 15:04:32.977533 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:32.977497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-zl8r4_01afa6b0-5352-45fc-ba8a-baa6802c9fe7/monitoring-plugin/0.log" Jun 05 15:04:33.110505 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.110476 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqt2m_5363541f-fa69-48bc-8415-ed5f153fa40c/node-exporter/0.log" Jun 05 15:04:33.137052 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.137025 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqt2m_5363541f-fa69-48bc-8415-ed5f153fa40c/kube-rbac-proxy/0.log" Jun 05 15:04:33.164531 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.164447 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-tqt2m_5363541f-fa69-48bc-8415-ed5f153fa40c/init-textfile/0.log" Jun 05 15:04:33.440360 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.440278 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/prometheus/0.log" Jun 05 15:04:33.463380 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.463346 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/config-reloader/0.log" Jun 05 15:04:33.487929 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.487886 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/thanos-sidecar/0.log" Jun 05 15:04:33.522545 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.522497 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/kube-rbac-proxy-web/0.log" Jun 05 15:04:33.549443 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.549403 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/kube-rbac-proxy/0.log" Jun 05 15:04:33.576719 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.576695 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/kube-rbac-proxy-thanos/0.log" Jun 05 15:04:33.626569 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.626315 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22070c39-d194-4405-9061-814c019c8110/init-config-reloader/0.log" Jun 05 15:04:33.735210 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:33.735109 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-tb2p7_c470bf1c-d948-435a-b521-8dbe64d0c4d6/prometheus-operator-admission-webhook/0.log" Jun 05 15:04:36.116102 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:36.116073 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/1.log" Jun 05 15:04:36.129913 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:36.129815 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-hgbfn_6417806e-53c9-4c3b-b377-675ab5b7363e/console-operator/2.log" Jun 05 15:04:36.727048 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:36.726989 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-6gzvr_c83887bd-846e-4827-b64a-e1bd785d1005/download-server/0.log" Jun 05 15:04:37.273638 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.273601 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69"] Jun 05 15:04:37.280598 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.280569 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.293632 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.293074 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69"] Jun 05 15:04:37.371505 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.371461 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-podres\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.371828 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.371808 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-sys\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.372030 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.371991 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-lib-modules\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.372132 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.372069 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v458f\" (UniqueName: \"kubernetes.io/projected/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-kube-api-access-v458f\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.372245 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.372149 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-proc\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.433374 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.433329 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-5z4h9_a5207cd3-3728-46ba-8513-d4c9cad0a269/volume-data-source-validator/0.log" Jun 05 15:04:37.473343 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473301 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-proc\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.473548 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473396 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-podres\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.473548 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473442 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-sys\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.473548 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473473 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-lib-modules\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.473548 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v458f\" (UniqueName: \"kubernetes.io/projected/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-kube-api-access-v458f\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.473986 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.473962 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-proc\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.474141 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.474003 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-sys\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.474141 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.474062 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-podres\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.474141 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.474074 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-lib-modules\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.482543 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.482512 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v458f\" (UniqueName: \"kubernetes.io/projected/7c28e5f2-6ec7-4f16-b685-d9d3627880ec-kube-api-access-v458f\") pod \"perf-node-gather-daemonset-qrf69\" (UID: \"7c28e5f2-6ec7-4f16-b685-d9d3627880ec\") " pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.594786 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.594752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:37.780037 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:37.780001 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69"] Jun 05 15:04:37.780560 ip-10-0-141-39 kubenswrapper[2575]: W0605 15:04:37.780535 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7c28e5f2_6ec7_4f16_b685_d9d3627880ec.slice/crio-a1f2212c54cde7948ab6830468cedd2fca381d89f9f65a671520ed8c184c9db1 WatchSource:0}: Error finding container a1f2212c54cde7948ab6830468cedd2fca381d89f9f65a671520ed8c184c9db1: Status 404 returned error can't find the container with id a1f2212c54cde7948ab6830468cedd2fca381d89f9f65a671520ed8c184c9db1 Jun 05 15:04:38.574105 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.574071 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-966l6_3acd96f0-ac8e-4314-87b0-92323f4d8d7f/dns/0.log" Jun 05 15:04:38.595945 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.595916 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-966l6_3acd96f0-ac8e-4314-87b0-92323f4d8d7f/kube-rbac-proxy/0.log" Jun 05 15:04:38.648630 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.648591 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" event={"ID":"7c28e5f2-6ec7-4f16-b685-d9d3627880ec","Type":"ContainerStarted","Data":"e9930dff5598180680e9e2978a648e0661b683eadd5063f8162f92ec36925095"} Jun 05 15:04:38.648802 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.648661 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:38.648802 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.648679 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" event={"ID":"7c28e5f2-6ec7-4f16-b685-d9d3627880ec","Type":"ContainerStarted","Data":"a1f2212c54cde7948ab6830468cedd2fca381d89f9f65a671520ed8c184c9db1"} Jun 05 15:04:38.664251 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.664172 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" podStartSLOduration=1.664150529 podStartE2EDuration="1.664150529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 15:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 15:04:38.662850934 +0000 UTC m=+3222.965633427" watchObservedRunningTime="2026-06-05 15:04:38.664150529 +0000 UTC m=+3222.966933023" Jun 05 15:04:38.695532 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:38.695488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-dpbd5_3fdd4cf1-9bbc-4949-877f-2f14852b404f/dns-node-resolver/0.log" Jun 05 15:04:39.340138 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:39.340047 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-sqk5n_a30f8f32-4b1a-4b12-9d24-dba98634a0ae/node-ca/0.log" Jun 05 15:04:40.345607 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:40.345574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qvd8r_c49182eb-4247-4afc-ac96-5e5a0cc5069d/istio-proxy/0.log" Jun 05 15:04:40.495225 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:40.495168 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/0.log" Jun 05 15:04:40.559215 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:40.559178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/1.log" Jun 05 15:04:40.711908 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:40.711805 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cdc78777f-kkqpt_bcca4fde-001e-4fbb-a070-57978e55379e/router/0.log" Jun 05 15:04:41.389573 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:41.389540 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rb546_76018a2b-b732-4ab4-a180-601527a27ef4/serve-healthcheck-canary/0.log" Jun 05 15:04:42.149908 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:42.149880 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9gr5_d569362d-8cc8-4d27-8e5c-7295b1aeaaaf/kube-rbac-proxy/0.log" Jun 05 15:04:42.171135 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:42.171099 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9gr5_d569362d-8cc8-4d27-8e5c-7295b1aeaaaf/exporter/0.log" Jun 05 15:04:42.193041 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:42.193005 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n9gr5_d569362d-8cc8-4d27-8e5c-7295b1aeaaaf/extractor/0.log" Jun 05 15:04:44.458828 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:44.458795 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-77985dbbcc-x7wt9_f915661d-4819-4817-9a19-3bc5c964baf8/nginx/0.log" Jun 05 15:04:44.643239 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:44.643208 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29677845-7l67q_845b9821-2900-4580-b2bc-92c4c1dd3611/cleanup/0.log" Jun 05 15:04:44.665817 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:44.665789 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-l5npr/perf-node-gather-daemonset-qrf69" Jun 05 15:04:44.669827 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:44.669802 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29677860-cb5k4_38dae246-ce54-47a7-bd0a-1c28c25b314c/cleanup/0.log" Jun 05 15:04:45.177022 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:45.176983 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649f7d5648-xm9v9_d7d18f7a-a830-463c-91bc-52b34c76c08d/manager/0.log" Jun 05 15:04:45.194709 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:45.194677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-649f7d5648-xm9v9_d7d18f7a-a830-463c-91bc-52b34c76c08d/copy-manifests/0.log" Jun 05 15:04:47.138052 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:47.138021 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-856cfbf6b6-nk4ws_27dadcf1-59b2-4a8c-a9bc-d844886cc2c7/manager/0.log" Jun 05 15:04:50.918375 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:50.918335 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qvd8r_c49182eb-4247-4afc-ac96-5e5a0cc5069d/istio-proxy/0.log" Jun 05 15:04:51.034578 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:51.034535 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/0.log" Jun 05 15:04:51.101476 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:51.101436 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/1.log" Jun 05 15:04:51.223160 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:51.223075 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cdc78777f-kkqpt_bcca4fde-001e-4fbb-a070-57978e55379e/router/0.log" Jun 05 15:04:52.351796 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:52.351766 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qvd8r_c49182eb-4247-4afc-ac96-5e5a0cc5069d/istio-proxy/0.log" Jun 05 15:04:52.465469 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:52.465415 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/0.log" Jun 05 15:04:52.523515 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:52.523477 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/1.log" Jun 05 15:04:52.657716 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:52.657621 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cdc78777f-kkqpt_bcca4fde-001e-4fbb-a070-57978e55379e/router/0.log" Jun 05 15:04:53.588756 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:53.588719 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-8t4hd_64e81c03-b8c9-4aea-af2c-c2fc87e78600/kube-storage-version-migrator-operator/1.log" Jun 05 15:04:53.590442 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:53.590413 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-8t4hd_64e81c03-b8c9-4aea-af2c-c2fc87e78600/kube-storage-version-migrator-operator/0.log" Jun 05 15:04:54.353785 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:54.353750 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795qvd8r_c49182eb-4247-4afc-ac96-5e5a0cc5069d/istio-proxy/0.log" Jun 05 15:04:54.456269 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:54.456232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/0.log" Jun 05 15:04:54.519125 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:54.519089 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-svksd_37b2efec-939a-4544-be80-6de06a2318bd/istio-proxy/1.log" Jun 05 15:04:54.633956 ip-10-0-141-39 kubenswrapper[2575]: I0605 15:04:54.633871 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-cdc78777f-kkqpt_bcca4fde-001e-4fbb-a070-57978e55379e/router/0.log"