Jun 11 16:08:53.233675 ip-10-0-138-8 systemd[1]: Starting Kubernetes Kubelet... Jun 11 16:08:53.610827 ip-10-0-138-8 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:08:53.610827 ip-10-0-138-8 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 16:08:53.610827 ip-10-0-138-8 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:08:53.610827 ip-10-0-138-8 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 16:08:53.610827 ip-10-0-138-8 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 16:08:53.611648 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.611556 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 16:08:53.617349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617333 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.617349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617348 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617352 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617358 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617362 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617366 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617370 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617373 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617376 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617379 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617393 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617397 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617399 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617402 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617405 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617409 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617413 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617423 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617426 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617429 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.617426 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617432 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617435 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617440 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617444 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617446 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617449 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617452 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617455 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617458 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617461 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617464 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617467 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617469 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617473 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617475 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617478 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617481 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617483 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617486 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617488 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.617888 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617490 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617493 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617496 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617499 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617502 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617504 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617507 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617509 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617512 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617514 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617517 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617519 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617522 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617524 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617527 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617530 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617533 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617535 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617538 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617541 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.618370 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617543 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617546 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617549 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617553 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617555 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617558 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617560 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617563 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617566 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617568 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617571 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617580 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617583 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617585 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617588 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617590 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617592 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617595 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617598 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617601 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.618899 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617603 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617606 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617608 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617611 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617614 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617616 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617620 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617623 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617625 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617628 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617630 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617633 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617636 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617639 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617642 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617644 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617647 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617649 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.617652 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618460 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.619378 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618473 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618476 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618479 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618482 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618485 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618488 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618490 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618493 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618496 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618501 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618507 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618510 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618514 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618517 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618520 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618522 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618525 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618528 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618530 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.619885 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618533 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618536 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618539 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618541 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618544 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618546 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618549 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618551 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618553 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618556 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618558 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618561 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618563 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618568 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618570 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618573 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618576 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618578 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618582 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618586 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.620351 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618589 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618592 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618595 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618597 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618600 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618602 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618605 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618607 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618610 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618612 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618615 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618617 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618620 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618622 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618625 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618627 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618630 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618632 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618634 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618637 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.620857 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618639 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618642 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618645 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618647 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618650 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618653 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618656 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618660 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618662 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618665 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618667 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618670 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618672 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618675 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618677 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618680 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618682 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618685 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618687 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618690 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.621349 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618692 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618695 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618697 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618700 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618702 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618705 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618707 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618710 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618712 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618714 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618717 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618719 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618722 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618725 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618728 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618730 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618734 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618737 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.618740 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619186 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.621863 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619192 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619196 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619199 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619202 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619205 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619207 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619210 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619212 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619215 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619219 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619223 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619225 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619228 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619231 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619233 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619236 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619239 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619241 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619244 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619247 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.622341 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619249 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619252 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619254 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619257 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619259 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619262 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619265 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619268 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619271 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619274 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619276 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619279 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619283 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619286 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619290 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619293 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619296 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619299 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619301 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.622854 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619304 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619307 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619309 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619312 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619314 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619317 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619320 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619322 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619325 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619329 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619332 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619334 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619337 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619339 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619342 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619344 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619347 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619350 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619353 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.623328 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619355 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619358 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619361 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619363 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619366 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619368 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619372 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619375 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619377 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619380 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619400 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619403 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619405 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619408 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619411 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619413 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619416 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619418 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619421 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619423 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.623917 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619426 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619428 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619431 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619434 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619436 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619439 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619441 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619443 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619446 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619448 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619452 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619454 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619457 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619459 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619462 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619465 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619468 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619470 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619473 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.619476 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619546 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 16:08:53.624523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619554 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619560 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619567 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619572 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619586 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619590 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619594 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619597 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619600 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619605 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619608 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619611 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619614 2562 flags.go:64] FLAG: --cgroup-root="" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619617 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619620 2562 flags.go:64] FLAG: --client-ca-file="" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619623 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619626 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619631 2562 flags.go:64] FLAG: --cluster-domain="" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619634 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619637 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619640 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619643 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619647 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 16:08:53.625031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619650 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619656 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619659 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619662 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619665 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619668 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619671 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619674 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619679 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619682 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619684 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619687 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619690 2562 flags.go:64] FLAG: --enable-server="true" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619693 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619698 2562 flags.go:64] FLAG: --event-burst="100" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619701 2562 flags.go:64] FLAG: --event-qps="50" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619704 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619707 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619710 2562 flags.go:64] FLAG: --eviction-hard="" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619714 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619717 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619720 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619723 2562 flags.go:64] FLAG: --eviction-soft="" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619726 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619729 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 16:08:53.625595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619735 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619738 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619741 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619744 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619747 2562 flags.go:64] FLAG: --feature-gates="" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619751 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619754 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619757 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619761 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619765 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619768 2562 flags.go:64] FLAG: --help="false" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619771 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619774 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619777 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619780 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619783 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619788 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619791 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619794 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619797 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619799 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619803 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619806 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619809 2562 flags.go:64] FLAG: --kube-reserved="" Jun 11 16:08:53.626310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619813 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619816 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619819 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619821 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619824 2562 flags.go:64] FLAG: --lock-file="" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619827 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619830 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619833 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619840 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619843 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619846 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619849 2562 flags.go:64] FLAG: --logging-format="text" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619852 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619855 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619858 2562 flags.go:64] FLAG: --manifest-url="" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619861 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619867 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619870 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619874 2562 flags.go:64] FLAG: --max-pods="110" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619877 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619880 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619883 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619886 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619890 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619893 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 16:08:53.626931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619897 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619904 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619907 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619910 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619913 2562 flags.go:64] FLAG: --pod-cidr="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619916 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619922 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619924 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619928 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619931 2562 flags.go:64] FLAG: --port="10250" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619934 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619937 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ca6b35d375cc7181" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619940 2562 flags.go:64] FLAG: --qos-reserved="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619943 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619946 2562 flags.go:64] FLAG: --register-node="true" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619949 2562 flags.go:64] FLAG: --register-with-taints="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619953 2562 flags.go:64] FLAG: --registry-burst="10" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619957 2562 flags.go:64] FLAG: --registry-qps="5" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619960 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619963 2562 flags.go:64] FLAG: --reserved-memory="" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619966 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619969 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619973 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619977 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619980 2562 flags.go:64] FLAG: --runonce="false" Jun 11 16:08:53.627559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619983 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619986 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619989 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619992 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619995 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.619998 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620001 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620005 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620008 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620011 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620014 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620017 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620020 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620023 2562 flags.go:64] FLAG: --system-cgroups="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620026 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620032 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620035 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620038 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620042 2562 flags.go:64] FLAG: --tls-min-version="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620045 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620047 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620050 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620053 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620058 2562 flags.go:64] FLAG: --v="2" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620062 2562 flags.go:64] FLAG: --version="false" Jun 11 16:08:53.628186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620066 2562 flags.go:64] FLAG: --vmodule="" Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620070 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620073 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620197 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620203 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620209 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620212 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620215 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620218 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620220 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620223 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620226 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620228 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620231 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620234 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620237 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620240 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620242 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620245 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.628826 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620248 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620250 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620253 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620256 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620258 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620261 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620263 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620266 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620268 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620271 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620274 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620278 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620280 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620283 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620285 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620288 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620291 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620294 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620298 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620300 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.629304 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620303 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620305 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620308 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620310 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620313 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620315 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620318 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620320 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620323 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620326 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620329 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620331 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620334 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620336 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620339 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620341 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620344 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620347 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620349 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620352 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.629839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620355 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620358 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620361 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620364 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620367 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620370 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620373 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620375 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620378 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620381 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620397 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620400 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620404 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620408 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620411 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620413 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620416 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620419 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620422 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.630322 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620425 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620427 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620430 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620433 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620439 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620442 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620444 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620447 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620449 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620452 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620454 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620457 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620459 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620461 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620464 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620467 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620471 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620474 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620476 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620478 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.630839 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620481 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620483 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620486 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.620489 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.620495 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.627976 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.628000 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.628020 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.628026 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628102 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628108 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628111 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628116 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628120 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628124 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.631330 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628127 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628142 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628147 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628150 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628153 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628156 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628160 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628163 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628166 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628169 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628173 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628176 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628180 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628183 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628185 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628189 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628192 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628195 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628198 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.631732 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628201 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628204 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628207 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628210 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628214 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628217 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628220 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628223 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628225 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628228 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628230 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628233 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628237 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628240 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628243 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628246 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628249 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628252 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628254 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628257 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.632198 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628260 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628263 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628265 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628268 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628271 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628273 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628276 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628279 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628281 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628284 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628287 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628290 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628292 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628295 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628297 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628300 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628304 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628307 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628309 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628312 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.632704 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628315 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628318 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628320 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628323 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628325 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628328 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628330 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628333 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628336 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628338 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628341 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628344 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628346 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628348 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628351 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628354 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628356 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628359 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628361 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628364 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.633195 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628367 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628370 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628372 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628375 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628377 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628380 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628398 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628402 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628405 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628408 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628412 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628414 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628417 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628420 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.628425 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:08:53.633695 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628583 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628588 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628591 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628594 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628603 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628606 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628608 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628611 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628614 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628616 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628619 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628621 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628624 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628626 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628629 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628631 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628634 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628637 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628640 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628642 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 16:08:53.634084 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628644 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628647 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628649 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628652 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628654 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628657 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628660 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628663 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628671 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628674 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628677 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628680 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628682 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628685 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628687 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628689 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628692 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628696 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628699 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 16:08:53.634609 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628702 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628705 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628707 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628710 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628712 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628715 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628717 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628720 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628722 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628725 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628728 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628730 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628733 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628735 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628738 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628740 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628743 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628745 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628748 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628750 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 16:08:53.635080 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628753 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628756 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628764 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628767 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628769 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628772 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628774 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628777 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628780 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628782 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628785 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628787 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628790 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628792 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628795 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628797 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628800 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628802 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628805 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628807 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 16:08:53.635701 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628810 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628812 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628815 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628818 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628820 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628822 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628825 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628827 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628830 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628834 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628838 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628841 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628844 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628847 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628850 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628859 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628862 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628864 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628867 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 16:08:53.636196 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:53.628870 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.628875 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.629024 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.633927 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.635376 2562 server.go:1019] "Starting client certificate rotation" Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.635514 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:08:53.636705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.635543 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 16:08:53.638215 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.638201 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:08:53.642248 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.642132 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 16:08:53.653893 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.653875 2562 log.go:25] "Validated CRI v1 runtime API" Jun 11 16:08:53.657285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.657267 2562 log.go:25] "Validated CRI v1 image API" Jun 11 16:08:53.658134 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.658119 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 16:08:53.660859 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.660839 2562 fs.go:135] Filesystem UUIDs: map[7926ad4a-93b1-4e32-ba36-151f67d38f8e:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 afae2247-ecac-4ffd-aa0c-762e63b85974:/dev/nvme0n1p4] Jun 11 16:08:53.660916 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.660858 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 16:08:53.665035 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.665018 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:08:53.665806 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.665702 2562 manager.go:216] Machine: {Timestamp:2026-06-11 16:08:53.664496313 +0000 UTC m=+0.318468121 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101290 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec204b04ab5908f1dcb3a4d3b83c9361 SystemUUID:ec204b04-ab59-08f1-dcb3-a4d3b83c9361 BootID:591c285d-84b3-42b8-8946-1fe8af90ef2b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:c6:d4:3a:c7:cb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:c6:d4:3a:c7:cb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:43:b2:91:32:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 16:08:53.665806 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.665807 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 16:08:53.665926 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.665914 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 16:08:53.666942 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.666919 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 16:08:53.667082 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.666945 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-8.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 16:08:53.667774 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.667763 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 16:08:53.667810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.667777 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 16:08:53.667810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.667785 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:08:53.669226 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.669216 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 16:08:53.670495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.670485 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 16:08:53.673878 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.673866 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:08:53.674153 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674143 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 16:08:53.674182 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674174 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 11 16:08:53.674212 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674185 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 16:08:53.674212 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674196 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 16:08:53.674212 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674207 2562 kubelet.go:398] "Adding apiserver pod source" Jun 11 16:08:53.674285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674218 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 16:08:53.674579 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674566 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:08:53.674630 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.674594 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 16:08:53.676616 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.676602 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 16:08:53.678301 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.678286 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 16:08:53.678346 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.678328 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 16:08:53.679217 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679205 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679223 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679229 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679235 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679243 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679250 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 16:08:53.679262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679262 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 16:08:53.679429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679268 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 16:08:53.679429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679275 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 16:08:53.679429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679281 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 16:08:53.679429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679296 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 16:08:53.679429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.679302 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 16:08:53.680064 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.680053 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 16:08:53.680098 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.680065 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 16:08:53.683362 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.683343 2562 server.go:1268] "Started kubelet" Jun 11 16:08:53.683494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.683464 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 16:08:53.684177 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.683674 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 16:08:53.684177 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.683935 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 16:08:53.684376 ip-10-0-138-8 systemd[1]: Started Kubernetes Kubelet. Jun 11 16:08:53.685897 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.685884 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 11 16:08:53.686636 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.686579 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-8.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 16:08:53.686903 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.686830 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 16:08:53.686993 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.686951 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-8.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 16:08:53.690286 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.690261 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dl5q5" Jun 11 16:08:53.690358 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.690325 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 16:08:53.691885 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.691854 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 16:08:53.692550 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.691655 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-8.ec2.internal.18b812a09e33e679 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-8.ec2.internal,UID:ip-10-0-138-8.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-8.ec2.internal,},FirstTimestamp:2026-06-11 16:08:53.683299961 +0000 UTC m=+0.337271741,LastTimestamp:2026-06-11 16:08:53.683299961 +0000 UTC m=+0.337271741,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-8.ec2.internal,}" Jun 11 16:08:53.696421 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.696403 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 16:08:53.696421 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.696411 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 16:08:53.696554 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.696518 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:53.697111 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697081 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 16:08:53.697111 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697085 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 16:08:53.697111 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697109 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 16:08:53.697285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697231 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 11 16:08:53.697285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697240 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 11 16:08:53.697285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697277 2562 factory.go:55] Registering systemd factory Jun 11 16:08:53.697285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697288 2562 factory.go:223] Registration of the systemd container factory successfully Jun 11 16:08:53.697518 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697504 2562 factory.go:153] Registering CRI-O factory Jun 11 16:08:53.697568 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697522 2562 factory.go:223] Registration of the crio container factory successfully Jun 11 16:08:53.697618 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697606 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 16:08:53.697670 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697630 2562 factory.go:103] Registering Raw factory Jun 11 16:08:53.697670 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697648 2562 manager.go:1196] Started watching for new ooms in manager Jun 11 16:08:53.697975 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.697961 2562 manager.go:349] Starting recovery of all containers Jun 11 16:08:53.698496 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.698479 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-dl5q5" Jun 11 16:08:53.706031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.706003 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 16:08:53.706962 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.706942 2562 manager.go:354] Recovery completed Jun 11 16:08:53.710910 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.710893 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:53.711654 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.711640 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.713333 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.713318 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.713403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.713342 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.713403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.713352 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.713970 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.713956 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.714295 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714282 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 16:08:53.714295 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714293 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 16:08:53.714427 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714308 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 11 16:08:53.714656 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714642 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.714702 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714667 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.714702 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.714677 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.715524 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.715511 2562 policy_none.go:49] "None policy: Start" Jun 11 16:08:53.715567 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.715536 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 16:08:53.715567 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.715546 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 16:08:53.716849 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.716836 2562 policy_none.go:47] "Start" Jun 11 16:08:53.719522 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.719499 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-8.ec2.internal\" not found" node="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.752380 2562 manager.go:337] "Starting Device Plugin manager" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.752503 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.752516 2562 server.go:87] "Starting device plugin registration server" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.752782 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.752794 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.753265 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.753343 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 16:08:53.753776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.753351 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.753954 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.754012 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.769068 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.769110 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.769132 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 16:08:53.769543 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.769171 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 16:08:53.774957 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.774939 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:53.853856 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.853814 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.854949 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.854932 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.855016 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.854963 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.855016 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.854973 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.855016 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.854999 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.865467 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.865450 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.865542 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.865474 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-8.ec2.internal\": node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:53.869415 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.869381 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal"] Jun 11 16:08:53.869464 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.869458 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.871863 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.871840 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.871945 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.871877 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.871945 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.871891 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.873168 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873156 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.873286 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.873327 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873289 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.873859 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873834 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.873940 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873865 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.873940 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873878 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.873940 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873898 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.873940 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873908 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.873940 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.873881 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.874924 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.874909 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.875001 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.874932 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 16:08:53.875644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.875630 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientMemory" Jun 11 16:08:53.875700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.875656 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 16:08:53.875700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.875670 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeHasSufficientPID" Jun 11 16:08:53.896039 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.896019 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-8.ec2.internal\" not found" node="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.898206 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.898184 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3963a799e27f3367f2e8f417ee82df7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-8.ec2.internal\" (UID: \"b3963a799e27f3367f2e8f417ee82df7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.898300 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.898213 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.898300 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.898244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.900578 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.900560 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-8.ec2.internal\" not found" node="ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.901542 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:53.901525 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:53.999199 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3963a799e27f3367f2e8f417ee82df7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-8.ec2.internal\" (UID: \"b3963a799e27f3367f2e8f417ee82df7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.999199 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999204 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.999450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.999450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.999450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999286 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b3963a799e27f3367f2e8f417ee82df7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-8.ec2.internal\" (UID: \"b3963a799e27f3367f2e8f417ee82df7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:53.999450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:53.999305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/639b02a7baabd024ec9b30207a1f5e94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal\" (UID: \"639b02a7baabd024ec9b30207a1f5e94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:54.002288 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.002275 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.102378 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.102347 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.202509 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.202429 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:54.202630 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.202436 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.206508 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.206487 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:54.303424 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.303374 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.403878 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.403845 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.504449 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.504418 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.604935 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.604903 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.635113 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.635086 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 16:08:54.635771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.635298 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:08:54.635771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.635298 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 16:08:54.700560 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.700523 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 16:03:53 +0000 UTC" deadline="2028-03-15 11:52:07.376855614 +0000 UTC" Jun 11 16:08:54.700560 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.700553 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15427h43m12.676305845s" Jun 11 16:08:54.705828 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.705800 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.722860 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:54.722826 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639b02a7baabd024ec9b30207a1f5e94.slice/crio-a29ff605433204b72141666e16da1d9aaba1b57276666b69a69b17abf9987eb9 WatchSource:0}: Error finding container a29ff605433204b72141666e16da1d9aaba1b57276666b69a69b17abf9987eb9: Status 404 returned error can't find the container with id a29ff605433204b72141666e16da1d9aaba1b57276666b69a69b17abf9987eb9 Jun 11 16:08:54.723058 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:54.723038 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3963a799e27f3367f2e8f417ee82df7.slice/crio-3f893264cdd321985962a206e6c69c47f8db8c23d739e421a877604fef398047 WatchSource:0}: Error finding container 3f893264cdd321985962a206e6c69c47f8db8c23d739e421a877604fef398047: Status 404 returned error can't find the container with id 3f893264cdd321985962a206e6c69c47f8db8c23d739e421a877604fef398047 Jun 11 16:08:54.728721 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.728705 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:08:54.772331 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.772229 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" event={"ID":"b3963a799e27f3367f2e8f417ee82df7","Type":"ContainerStarted","Data":"3f893264cdd321985962a206e6c69c47f8db8c23d739e421a877604fef398047"} Jun 11 16:08:54.773321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:54.773299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" event={"ID":"639b02a7baabd024ec9b30207a1f5e94","Type":"ContainerStarted","Data":"a29ff605433204b72141666e16da1d9aaba1b57276666b69a69b17abf9987eb9"} Jun 11 16:08:54.806741 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.806709 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:54.907283 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:54.907251 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:55.007737 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.007710 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:55.108341 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.108265 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:55.209167 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.209130 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-8.ec2.internal\" not found" Jun 11 16:08:55.229207 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.229176 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:55.281166 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.281138 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:55.297633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.297599 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" Jun 11 16:08:55.310949 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.310920 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:08:55.312138 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.312104 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" Jun 11 16:08:55.323311 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.323282 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 16:08:55.441332 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.441254 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:55.676438 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.676376 2562 apiserver.go:52] "Watching apiserver" Jun 11 16:08:55.684109 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.684083 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 16:08:55.684530 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.684505 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ntgfl","openshift-image-registry/node-ca-7msjq","openshift-multus/multus-additional-cni-plugins-8l8nc","openshift-multus/multus-bm47z","openshift-multus/network-metrics-daemon-5cszm","openshift-ovn-kubernetes/ovnkube-node-8wp94","kube-system/global-pull-secret-syncer-qvvst","kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal","openshift-cluster-node-tuning-operator/tuned-7xr7h","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal","openshift-network-diagnostics/network-check-target-65bmr","openshift-network-operator/iptables-alerter-h9dp7","kube-system/konnectivity-agent-krdfw","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz"] Jun 11 16:08:55.686097 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.686076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:55.686219 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.686153 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:08:55.687230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.687204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.688740 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.688708 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.689347 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.689366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.689965 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-w6frk\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.689988 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.690946 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.691034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qhsp7\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.691294 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.691453 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.691968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.691791 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 16:08:55.692420 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.692264 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.692786 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.692707 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.693833 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.693649 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.693833 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.693710 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:08:55.694892 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.694801 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 16:08:55.694994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.694983 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.695113 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.695091 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.695508 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.695487 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gztfr\"" Jun 11 16:08:55.695612 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.695513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.696609 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.696163 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.696932 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.696910 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.696998 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.696937 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vdnpw\"" Jun 11 16:08:55.697097 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697052 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 16:08:55.697182 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697141 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 16:08:55.697236 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697205 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 16:08:55.697287 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697278 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 16:08:55.697483 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697466 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 16:08:55.698156 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.697730 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.698236 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.698208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.698282 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.698243 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 16:08:55.698320 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.698283 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 16:08:55.698568 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.698552 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lrcbg\"" Jun 11 16:08:55.699092 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.699007 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.699419 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.699400 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.699899 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.699694 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 16:08:55.699899 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.699731 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.699899 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.699733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-jgkxs\"" Jun 11 16:08:55.700244 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.700209 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.700315 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.700276 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:08:55.700581 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.700564 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.701469 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.701430 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.701563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.701439 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-s77mk\"" Jun 11 16:08:55.701620 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.701569 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.702840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.702812 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.703181 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.703164 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 16:08:55.703265 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.703250 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 16:08:55.703349 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.703330 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g2xvx\"" Jun 11 16:08:55.704651 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.704576 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 16:08:55.705045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.705024 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5khmn\"" Jun 11 16:08:55.708073 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708051 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 16:08:55.708723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mwzv\" (UniqueName: \"kubernetes.io/projected/70bd67a7-9c07-4bbc-a261-8da7f252bc91-kube-api-access-4mwzv\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.708829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708741 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.708829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-agent-certs\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.708829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-konnectivity-ca\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.708829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-cnibin\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708839 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708874 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-systemd-units\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-var-lib-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708924 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-netd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-script-lib\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.708987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709026 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-kubelet\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709072 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-node-log\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709096 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-bin\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709148 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-system-cni-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709181 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709208 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx4w7\" (UniqueName: \"kubernetes.io/projected/4124af47-3674-4853-8fa4-0498e79ebff8-kube-api-access-vx4w7\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709268 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-socket-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709285 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709315 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7c93a39-1a05-45d5-aba4-9a89397d5322-host-slash\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.709404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709341 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-systemd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709481 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70bd67a7-9c07-4bbc-a261-8da7f252bc91-serviceca\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709519 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-sys-fs\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709593 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-549k6\" (UniqueName: \"kubernetes.io/projected/ef8579aa-025c-4bc3-b190-6610c84e8feb-kube-api-access-549k6\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709630 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7c93a39-1a05-45d5-aba4-9a89397d5322-iptables-alerter-script\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709658 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70bd67a7-9c07-4bbc-a261-8da7f252bc91-host\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709682 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-log-socket\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709703 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gck\" (UniqueName: \"kubernetes.io/projected/7b8489e1-f957-4181-b952-1f28e581006c-kube-api-access-v9gck\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8g5qh\" (UniqueName: \"kubernetes.io/projected/33081167-5c97-4e5b-880c-6d485669e4a6-kube-api-access-8g5qh\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709782 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-config\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709821 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-env-overrides\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-device-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.709872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmg4n\" (UniqueName: \"kubernetes.io/projected/e7c93a39-1a05-45d5-aba4-9a89397d5322-kube-api-access-jmg4n\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709938 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-etc-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.709991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-os-release\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710018 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710058 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-registration-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710088 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-slash\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710116 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-netns\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710139 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-ovn\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.710604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.710164 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8489e1-f957-4181-b952-1f28e581006c-ovn-node-metrics-cert\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.731587 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.731567 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-srh68" Jun 11 16:08:55.740681 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.740658 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-srh68" Jun 11 16:08:55.798351 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.798318 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 16:08:55.810762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810708 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-os-release\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.810762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810751 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-registration-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810774 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-netns\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810800 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-netns\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-os-release\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-cni-binary-copy\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-kubelet\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810877 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-netns\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810883 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-registration-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810887 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-sys\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810901 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810933 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-systemd-units\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-systemd-units\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.810994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.810990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-var-lib-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-netd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-script-lib\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811097 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-os-release\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811105 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-var-lib-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811120 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-daemon-config\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-node-log\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811264 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-netd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-dbus\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811304 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811327 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-modprobe-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811351 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-run\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-socket-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-systemd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.811770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811480 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gck\" (UniqueName: \"kubernetes.io/projected/7b8489e1-f957-4181-b952-1f28e581006c-kube-api-access-v9gck\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-cnibin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811553 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-var-lib-kubelet\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-tmp\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-sys-fs\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811624 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7c93a39-1a05-45d5-aba4-9a89397d5322-iptables-alerter-script\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811674 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-log-socket\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-host\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8g5qh\" (UniqueName: \"kubernetes.io/projected/33081167-5c97-4e5b-880c-6d485669e4a6-kube-api-access-8g5qh\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-env-overrides\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811885 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811907 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-socket-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-conf-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811952 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-lib-modules\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.812591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.811983 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-device-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysconfig\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812052 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812077 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-tuned\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812119 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-systemd\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-slash\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-ovn\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812224 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8489e1-f957-4181-b952-1f28e581006c-ovn-node-metrics-cert\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812251 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-multus\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812381 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-hostroot\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812430 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-systemd\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812478 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljzd5\" (UniqueName: \"kubernetes.io/projected/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-kube-api-access-ljzd5\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mwzv\" (UniqueName: \"kubernetes.io/projected/70bd67a7-9c07-4bbc-a261-8da7f252bc91-kube-api-access-4mwzv\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812550 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-agent-certs\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812553 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-script-lib\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-konnectivity-ca\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.813347 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812588 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-node-log\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812637 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-run-ovn\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-device-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812671 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2763331e-e015-4d97-a700-f8333064921e-hosts-file\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812704 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-k8s-cni-cncf-io\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812708 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-tuning-conf-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812739 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-multus-certs\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-cnibin\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812782 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812802 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-bin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812821 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-cnibin\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812841 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-kubelet\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-bin\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812874 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.812784 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812922 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-log-socket\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814146 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.812968 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:08:56.312931793 +0000 UTC m=+2.966903579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-system-cni-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.812985 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-sys-fs\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813037 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-slash\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx4w7\" (UniqueName: \"kubernetes.io/projected/4124af47-3674-4853-8fa4-0498e79ebff8-kube-api-access-vx4w7\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813079 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813130 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-cni-bin\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7c93a39-1a05-45d5-aba4-9a89397d5322-host-slash\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813169 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4124af47-3674-4853-8fa4-0498e79ebff8-system-cni-dir\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-host-kubelet\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813250 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813246 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2fm9\" (UniqueName: \"kubernetes.io/projected/2763331e-e015-4d97-a700-f8333064921e-kube-api-access-w2fm9\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813302 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70bd67a7-9c07-4bbc-a261-8da7f252bc91-serviceca\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-549k6\" (UniqueName: \"kubernetes.io/projected/ef8579aa-025c-4bc3-b190-6610c84e8feb-kube-api-access-549k6\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.814943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813406 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7c93a39-1a05-45d5-aba4-9a89397d5322-iptables-alerter-script\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70bd67a7-9c07-4bbc-a261-8da7f252bc91-host\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-konnectivity-ca\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2763331e-e015-4d97-a700-f8333064921e-tmp-dir\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7c93a39-1a05-45d5-aba4-9a89397d5322-host-slash\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813497 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-system-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813497 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/33081167-5c97-4e5b-880c-6d485669e4a6-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813560 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-binary-copy\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-env-overrides\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813700 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g87q5\" (UniqueName: \"kubernetes.io/projected/4c2e5f26-91ff-4b9f-a533-9332550260fe-kube-api-access-g87q5\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813722 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/70bd67a7-9c07-4bbc-a261-8da7f252bc91-host\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-kubernetes\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813776 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-config\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813815 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-kubelet-config\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813841 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-conf\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmg4n\" (UniqueName: \"kubernetes.io/projected/e7c93a39-1a05-45d5-aba4-9a89397d5322-kube-api-access-jmg4n\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813908 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-etc-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.815685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-socket-dir-parent\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.816270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.813989 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/70bd67a7-9c07-4bbc-a261-8da7f252bc91-serviceca\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.816270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.814003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-etc-kubernetes\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.816270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.814108 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4124af47-3674-4853-8fa4-0498e79ebff8-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.816270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.814118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/7b8489e1-f957-4181-b952-1f28e581006c-etc-openvswitch\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.816270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.814339 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/7b8489e1-f957-4181-b952-1f28e581006c-ovnkube-config\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.816457 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.816427 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b8489e1-f957-4181-b952-1f28e581006c-ovn-node-metrics-cert\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.816583 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.816561 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/76e343fd-6f32-49ed-96c2-c0ce6cb85a82-agent-certs\") pod \"konnectivity-agent-krdfw\" (UID: \"76e343fd-6f32-49ed-96c2-c0ce6cb85a82\") " pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:55.825250 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.825217 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 16:08:55.830315 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.830289 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:08:55.830315 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.830315 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:08:55.830505 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.830328 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:55.830505 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.830454 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:56.330434189 +0000 UTC m=+2.984405960 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:55.831584 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.831557 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mwzv\" (UniqueName: \"kubernetes.io/projected/70bd67a7-9c07-4bbc-a261-8da7f252bc91-kube-api-access-4mwzv\") pod \"node-ca-7msjq\" (UID: \"70bd67a7-9c07-4bbc-a261-8da7f252bc91\") " pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:55.831683 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.831606 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-549k6\" (UniqueName: \"kubernetes.io/projected/ef8579aa-025c-4bc3-b190-6610c84e8feb-kube-api-access-549k6\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:55.831752 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.831675 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8g5qh\" (UniqueName: \"kubernetes.io/projected/33081167-5c97-4e5b-880c-6d485669e4a6-kube-api-access-8g5qh\") pod \"aws-ebs-csi-driver-node-b6ncz\" (UID: \"33081167-5c97-4e5b-880c-6d485669e4a6\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:55.831894 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.831870 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmg4n\" (UniqueName: \"kubernetes.io/projected/e7c93a39-1a05-45d5-aba4-9a89397d5322-kube-api-access-jmg4n\") pod \"iptables-alerter-h9dp7\" (UID: \"e7c93a39-1a05-45d5-aba4-9a89397d5322\") " pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:55.832766 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.832748 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gck\" (UniqueName: \"kubernetes.io/projected/7b8489e1-f957-4181-b952-1f28e581006c-kube-api-access-v9gck\") pod \"ovnkube-node-8wp94\" (UID: \"7b8489e1-f957-4181-b952-1f28e581006c\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:55.832895 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.832880 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx4w7\" (UniqueName: \"kubernetes.io/projected/4124af47-3674-4853-8fa4-0498e79ebff8-kube-api-access-vx4w7\") pod \"multus-additional-cni-plugins-8l8nc\" (UID: \"4124af47-3674-4853-8fa4-0498e79ebff8\") " pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:55.914870 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914836 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-host\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.914870 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914871 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914898 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-conf-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-lib-modules\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914935 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysconfig\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914976 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-tuned\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914976 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-host\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.914999 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-multus\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-hostroot\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-systemd\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljzd5\" (UniqueName: \"kubernetes.io/projected/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-kube-api-access-ljzd5\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915085 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-lib-modules\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915095 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2763331e-e015-4d97-a700-f8333064921e-hosts-file\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.915105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-k8s-cni-cncf-io\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2763331e-e015-4d97-a700-f8333064921e-hosts-file\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.915267 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:55.915318 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:56.415304803 +0000 UTC m=+3.069276571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915436 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-multus\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-k8s-cni-cncf-io\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915512 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-hostroot\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-multus-certs\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.915805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-conf-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.916201 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915538 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysconfig\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.916315 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.915575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-multus-certs\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.916381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-systemd\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.916446 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916419 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-bin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.916521 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-cni-bin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.916577 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916541 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2fm9\" (UniqueName: \"kubernetes.io/projected/2763331e-e015-4d97-a700-f8333064921e-kube-api-access-w2fm9\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2763331e-e015-4d97-a700-f8333064921e-tmp-dir\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-system-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g87q5\" (UniqueName: \"kubernetes.io/projected/4c2e5f26-91ff-4b9f-a533-9332550260fe-kube-api-access-g87q5\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.916968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-kubernetes\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917000 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-kubelet-config\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917027 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-conf\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-socket-dir-parent\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-etc-kubernetes\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917123 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-system-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-netns\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-cni-binary-copy\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917184 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-kubernetes\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-kubelet\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917228 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-run-netns\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917240 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-sys\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-kubelet-config\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.919810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-os-release\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2763331e-e015-4d97-a700-f8333064921e-tmp-dir\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917357 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-os-release\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917341 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-daemon-config\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-dbus\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-modprobe-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-run\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917586 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-cnibin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-var-lib-kubelet\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-tmp\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917714 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-tuned\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-host-var-lib-kubelet\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-sys\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-cni-binary-copy\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.917962 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-daemon-config\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918017 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-etc-kubernetes\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-cni-dir\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.920725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918091 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-run\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918092 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-multus-socket-dir-parent\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918132 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-sysctl-conf\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918142 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-var-lib-kubelet\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918192 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-etc-modprobe-d\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918220 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c2e5f26-91ff-4b9f-a533-9332550260fe-cnibin\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.918296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1742c73f-8da9-4431-aa49-3f9f053a1d05-dbus\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:55.921474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.919948 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-tmp\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.926740 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.926718 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljzd5\" (UniqueName: \"kubernetes.io/projected/1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1-kube-api-access-ljzd5\") pod \"tuned-7xr7h\" (UID: \"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1\") " pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:55.929398 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.929363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2fm9\" (UniqueName: \"kubernetes.io/projected/2763331e-e015-4d97-a700-f8333064921e-kube-api-access-w2fm9\") pod \"node-resolver-ntgfl\" (UID: \"2763331e-e015-4d97-a700-f8333064921e\") " pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:55.929497 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:55.929455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g87q5\" (UniqueName: \"kubernetes.io/projected/4c2e5f26-91ff-4b9f-a533-9332550260fe-kube-api-access-g87q5\") pod \"multus-bm47z\" (UID: \"4c2e5f26-91ff-4b9f-a533-9332550260fe\") " pod="openshift-multus/multus-bm47z" Jun 11 16:08:56.000572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.000536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7msjq" Jun 11 16:08:56.009013 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.008986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" Jun 11 16:08:56.017768 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.017745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" Jun 11 16:08:56.021376 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.021353 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:08:56.027998 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.027976 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:08:56.035546 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.035514 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-h9dp7" Jun 11 16:08:56.043076 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.043056 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" Jun 11 16:08:56.049527 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.049508 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ntgfl" Jun 11 16:08:56.053967 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.053951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bm47z" Jun 11 16:08:56.320076 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.319986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:56.320218 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.320151 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:56.320279 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.320230 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:08:57.320212811 +0000 UTC m=+3.974184586 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:56.421285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.421244 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:56.421495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.421315 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:56.421495 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421444 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:56.421495 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421464 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:08:56.421495 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421492 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:08:56.421708 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421506 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:56.421708 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421531 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:57.421509772 +0000 UTC m=+4.075481552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:56.421708 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.421557 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:57.421540776 +0000 UTC m=+4.075512547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:56.511951 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.511926 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e6f59d0_18a4_40f7_9c5d_9b0358bd13f1.slice/crio-84f1fc94c7736e4c060d3a86e6436a7cf60fdc46a74437050cb1f7f953b22437 WatchSource:0}: Error finding container 84f1fc94c7736e4c060d3a86e6436a7cf60fdc46a74437050cb1f7f953b22437: Status 404 returned error can't find the container with id 84f1fc94c7736e4c060d3a86e6436a7cf60fdc46a74437050cb1f7f953b22437 Jun 11 16:08:56.513275 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.513249 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33081167_5c97_4e5b_880c_6d485669e4a6.slice/crio-307da3b79c62f37765752af42039633a4a72b5925c6c4568bbbca97d626c418a WatchSource:0}: Error finding container 307da3b79c62f37765752af42039633a4a72b5925c6c4568bbbca97d626c418a: Status 404 returned error can't find the container with id 307da3b79c62f37765752af42039633a4a72b5925c6c4568bbbca97d626c418a Jun 11 16:08:56.514265 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.514196 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c93a39_1a05_45d5_aba4_9a89397d5322.slice/crio-0cb63f4239bd59599977c630254bff50ace3ad94cf1b0ab94b117ad147487e5a WatchSource:0}: Error finding container 0cb63f4239bd59599977c630254bff50ace3ad94cf1b0ab94b117ad147487e5a: Status 404 returned error can't find the container with id 0cb63f4239bd59599977c630254bff50ace3ad94cf1b0ab94b117ad147487e5a Jun 11 16:08:56.517788 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.517666 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e343fd_6f32_49ed_96c2_c0ce6cb85a82.slice/crio-31a7a807be9832f95ccacfecd498ec51ec411b6c823e93c7cf5fe43e847dce4d WatchSource:0}: Error finding container 31a7a807be9832f95ccacfecd498ec51ec411b6c823e93c7cf5fe43e847dce4d: Status 404 returned error can't find the container with id 31a7a807be9832f95ccacfecd498ec51ec411b6c823e93c7cf5fe43e847dce4d Jun 11 16:08:56.518463 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.518439 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c2e5f26_91ff_4b9f_a533_9332550260fe.slice/crio-db6b9b21ac8209ebc30360e41f2a07e1edd5f0513c3a2e5a269d6347cbb7522b WatchSource:0}: Error finding container db6b9b21ac8209ebc30360e41f2a07e1edd5f0513c3a2e5a269d6347cbb7522b: Status 404 returned error can't find the container with id db6b9b21ac8209ebc30360e41f2a07e1edd5f0513c3a2e5a269d6347cbb7522b Jun 11 16:08:56.519798 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.519774 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8489e1_f957_4181_b952_1f28e581006c.slice/crio-7c335f7e9b69c6d170d99b69a248540860c6680841ef45a31713767d606fbae5 WatchSource:0}: Error finding container 7c335f7e9b69c6d170d99b69a248540860c6680841ef45a31713767d606fbae5: Status 404 returned error can't find the container with id 7c335f7e9b69c6d170d99b69a248540860c6680841ef45a31713767d606fbae5 Jun 11 16:08:56.520914 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.520742 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bd67a7_9c07_4bbc_a261_8da7f252bc91.slice/crio-eb4206b610e38d9c51472551b81251bdc0342c9c5f5c49be8fb5252932ece2af WatchSource:0}: Error finding container eb4206b610e38d9c51472551b81251bdc0342c9c5f5c49be8fb5252932ece2af: Status 404 returned error can't find the container with id eb4206b610e38d9c51472551b81251bdc0342c9c5f5c49be8fb5252932ece2af Jun 11 16:08:56.522490 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.522294 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4124af47_3674_4853_8fa4_0498e79ebff8.slice/crio-073eec7335f52fce4a64ff8f1e53ae58839ad22ffe650ecaa688824bdc6ecd58 WatchSource:0}: Error finding container 073eec7335f52fce4a64ff8f1e53ae58839ad22ffe650ecaa688824bdc6ecd58: Status 404 returned error can't find the container with id 073eec7335f52fce4a64ff8f1e53ae58839ad22ffe650ecaa688824bdc6ecd58 Jun 11 16:08:56.522681 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:08:56.522659 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2763331e_e015_4d97_a700_f8333064921e.slice/crio-af739101c4639165e9a8f9a9181538475c6ea7f3ec2330dbdc669b1b5c1a5631 WatchSource:0}: Error finding container af739101c4639165e9a8f9a9181538475c6ea7f3ec2330dbdc669b1b5c1a5631: Status 404 returned error can't find the container with id af739101c4639165e9a8f9a9181538475c6ea7f3ec2330dbdc669b1b5c1a5631 Jun 11 16:08:56.743276 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.743244 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:03:55 +0000 UTC" deadline="2027-11-17 12:10:31.802128756 +0000 UTC" Jun 11 16:08:56.743276 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.743270 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12572h1m35.058862078s" Jun 11 16:08:56.770254 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.770233 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:56.770355 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:56.770337 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:08:56.778726 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.778696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"7c335f7e9b69c6d170d99b69a248540860c6680841ef45a31713767d606fbae5"} Jun 11 16:08:56.779741 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.779711 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bm47z" event={"ID":"4c2e5f26-91ff-4b9f-a533-9332550260fe","Type":"ContainerStarted","Data":"db6b9b21ac8209ebc30360e41f2a07e1edd5f0513c3a2e5a269d6347cbb7522b"} Jun 11 16:08:56.780772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.780746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krdfw" event={"ID":"76e343fd-6f32-49ed-96c2-c0ce6cb85a82","Type":"ContainerStarted","Data":"31a7a807be9832f95ccacfecd498ec51ec411b6c823e93c7cf5fe43e847dce4d"} Jun 11 16:08:56.781905 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.781877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9dp7" event={"ID":"e7c93a39-1a05-45d5-aba4-9a89397d5322","Type":"ContainerStarted","Data":"0cb63f4239bd59599977c630254bff50ace3ad94cf1b0ab94b117ad147487e5a"} Jun 11 16:08:56.783435 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.783411 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" event={"ID":"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1","Type":"ContainerStarted","Data":"84f1fc94c7736e4c060d3a86e6436a7cf60fdc46a74437050cb1f7f953b22437"} Jun 11 16:08:56.785414 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.785370 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" event={"ID":"b3963a799e27f3367f2e8f417ee82df7","Type":"ContainerStarted","Data":"9f9fc46ba8bcb6f15ac65d88a6b10bd576584c48b676d4d55f74b4746babad29"} Jun 11 16:08:56.786492 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.786471 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntgfl" event={"ID":"2763331e-e015-4d97-a700-f8333064921e","Type":"ContainerStarted","Data":"af739101c4639165e9a8f9a9181538475c6ea7f3ec2330dbdc669b1b5c1a5631"} Jun 11 16:08:56.787538 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.787510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerStarted","Data":"073eec7335f52fce4a64ff8f1e53ae58839ad22ffe650ecaa688824bdc6ecd58"} Jun 11 16:08:56.788531 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.788511 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" event={"ID":"33081167-5c97-4e5b-880c-6d485669e4a6","Type":"ContainerStarted","Data":"307da3b79c62f37765752af42039633a4a72b5925c6c4568bbbca97d626c418a"} Jun 11 16:08:56.793936 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.793905 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7msjq" event={"ID":"70bd67a7-9c07-4bbc-a261-8da7f252bc91","Type":"ContainerStarted","Data":"eb4206b610e38d9c51472551b81251bdc0342c9c5f5c49be8fb5252932ece2af"} Jun 11 16:08:56.820469 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:56.820423 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-8.ec2.internal" podStartSLOduration=1.820403577 podStartE2EDuration="1.820403577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:08:56.820189883 +0000 UTC m=+3.474161674" watchObservedRunningTime="2026-06-11 16:08:56.820403577 +0000 UTC m=+3.474375357" Jun 11 16:08:57.328416 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.328361 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:57.328593 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.328533 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:57.328666 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.328596 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:08:59.328577808 +0000 UTC m=+5.982549582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:57.429229 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.429190 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:57.429431 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.429258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:57.429431 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429369 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:57.429431 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429424 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:08:57.429582 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429441 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:08:57.429582 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429455 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:57.429582 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429467 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:59.429441623 +0000 UTC m=+6.083413398 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:57.429582 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.429506 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:08:59.429489824 +0000 UTC m=+6.083461615 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:57.743903 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.743832 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 16:03:55 +0000 UTC" deadline="2027-11-23 02:36:27.761274298 +0000 UTC" Jun 11 16:08:57.743903 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.743903 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12706h27m30.017375525s" Jun 11 16:08:57.770093 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.769771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:57.770093 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.769938 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:08:57.770093 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.769981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:57.770350 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:57.770103 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:08:57.814952 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.814917 2562 generic.go:356] "Generic (PLEG): container finished" podID="639b02a7baabd024ec9b30207a1f5e94" containerID="77cac0452d951d0f2102c8e51b8df67821cdb08ee673c22fb73b6a3610bfd459" exitCode=0 Jun 11 16:08:57.815478 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:57.815449 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" event={"ID":"639b02a7baabd024ec9b30207a1f5e94","Type":"ContainerDied","Data":"77cac0452d951d0f2102c8e51b8df67821cdb08ee673c22fb73b6a3610bfd459"} Jun 11 16:08:58.770443 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:58.769908 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:58.770443 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:58.770041 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:08:58.849349 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:58.848678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" event={"ID":"639b02a7baabd024ec9b30207a1f5e94","Type":"ContainerStarted","Data":"7e9fd7a6a8f207fdfbe2d02308437df466135028f8e03ecbe9a7e16779db5200"} Jun 11 16:08:58.871885 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:58.871824 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-8.ec2.internal" podStartSLOduration=3.871803005 podStartE2EDuration="3.871803005s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:08:58.871640225 +0000 UTC m=+5.525612021" watchObservedRunningTime="2026-06-11 16:08:58.871803005 +0000 UTC m=+5.525774797" Jun 11 16:08:59.349656 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:59.349614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:59.349853 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.349817 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:59.349918 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.349884 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:09:03.349865158 +0000 UTC m=+10.003836933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:08:59.450707 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:59.450668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:59.450885 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:59.450759 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:08:59.450993 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.450977 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:08:59.451049 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.451001 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:08:59.451049 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.451014 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:59.451147 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.451076 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:03.451055388 +0000 UTC m=+10.105027157 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:08:59.451490 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.451470 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:59.451617 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.451536 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:03.451512764 +0000 UTC m=+10.105484533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:08:59.770996 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:59.770523 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:08:59.770996 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.770669 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:08:59.771540 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:08:59.771054 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:08:59.771540 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:08:59.771171 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:00.770297 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:00.770260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:00.770498 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:00.770434 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:01.769707 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:01.769672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:01.770189 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:01.769811 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:01.770189 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:01.769887 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:01.770189 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:01.769979 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:02.770319 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:02.770067 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:02.770319 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:02.770219 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:03.386662 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:03.386619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:03.386836 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.386769 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:03.386894 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.386842 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:09:11.386822903 +0000 UTC m=+18.040794678 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:03.487680 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:03.487031 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:03.487680 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:03.487151 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:03.487680 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487276 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:03.487680 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487336 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:11.487317784 +0000 UTC m=+18.141289590 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:03.488004 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487766 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:09:03.488004 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487791 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:09:03.488004 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487803 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:03.488004 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.487860 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:11.487842537 +0000 UTC m=+18.141814312 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:03.771069 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:03.771034 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:03.771669 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.771146 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:03.771669 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:03.771498 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:03.771669 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:03.771611 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:04.769569 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:04.769536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:04.769750 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:04.769672 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:05.769880 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:05.769847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:05.770322 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:05.769976 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:05.770413 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:05.770318 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:05.770489 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:05.770462 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:06.769712 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:06.769677 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:06.769902 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:06.769796 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:07.770430 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:07.770380 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:07.770430 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:07.770432 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:07.771019 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:07.770538 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:07.771019 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:07.770691 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:08.770237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:08.770200 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:08.770436 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:08.770308 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:09.769369 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:09.769341 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:09.769809 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:09.769463 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:09.769809 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:09.769563 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:09.769809 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:09.769681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:10.769315 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:10.769274 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:10.769510 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:10.769413 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:11.444202 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:11.444156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:11.444373 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.444329 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:11.444474 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.444426 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:09:27.444409141 +0000 UTC m=+34.098380910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:11.545300 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:11.545259 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:11.545486 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:11.545317 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:11.545486 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545433 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:11.545486 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545451 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:09:11.545486 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545467 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:09:11.545486 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545482 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:11.545692 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545517 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:27.545497689 +0000 UTC m=+34.199469478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:11.545692 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.545532 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:27.545525952 +0000 UTC m=+34.199497720 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:11.770028 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:11.769989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:11.770497 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:11.770075 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:11.770497 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.770204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:11.770497 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:11.770317 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:12.770401 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:12.770307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:12.770843 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:12.770456 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:13.773106 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:13.773074 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:13.773572 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:13.773200 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:13.773572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:13.773256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:13.773572 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:13.773373 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:14.770052 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:14.770023 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:14.770256 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:14.770129 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:15.769848 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.769630 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:15.770478 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.769690 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:15.770478 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:15.769974 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:15.770478 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:15.770023 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:15.883726 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.883583 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bm47z" event={"ID":"4c2e5f26-91ff-4b9f-a533-9332550260fe","Type":"ContainerStarted","Data":"fc335b254a159760aac1d56fba7fbcd950382cf3570a13d8f8e892da26c861dd"} Jun 11 16:09:15.884857 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.884832 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-krdfw" event={"ID":"76e343fd-6f32-49ed-96c2-c0ce6cb85a82","Type":"ContainerStarted","Data":"5f03ebd2515721c582cbff25ee3b0ded8c98398f5304a6f15a4972e32df2587a"} Jun 11 16:09:15.886105 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.886076 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" event={"ID":"1e6f59d0-18a4-40f7-9c5d-9b0358bd13f1","Type":"ContainerStarted","Data":"541a24d93428ba8d2590bd4fce119f1b174e8f8be9354d835f095ac1c3a28d8f"} Jun 11 16:09:15.887314 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.887296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ntgfl" event={"ID":"2763331e-e015-4d97-a700-f8333064921e","Type":"ContainerStarted","Data":"e7eb9bab2312b842999c6d731e501657d757e13f0f1b091fbfddf71de2a2f1fb"} Jun 11 16:09:15.888624 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.888605 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="0f30fcdb8985c980a0a90329ec09c99c3305f20fc8c320e862ddd58f6543a0ff" exitCode=0 Jun 11 16:09:15.888707 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.888662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"0f30fcdb8985c980a0a90329ec09c99c3305f20fc8c320e862ddd58f6543a0ff"} Jun 11 16:09:15.890064 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.890047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" event={"ID":"33081167-5c97-4e5b-880c-6d485669e4a6","Type":"ContainerStarted","Data":"a8c88149917d02d76ac8801e615344b098f63e438e3adad48874cf3a90be084e"} Jun 11 16:09:15.891507 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.891490 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7msjq" event={"ID":"70bd67a7-9c07-4bbc-a261-8da7f252bc91","Type":"ContainerStarted","Data":"2768394f39f5bc425cf793960548e77453024158a058e8c74a8a10d6b980c1b5"} Jun 11 16:09:15.893285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.893269 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:09:15.893640 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.893614 2562 generic.go:356] "Generic (PLEG): container finished" podID="7b8489e1-f957-4181-b952-1f28e581006c" containerID="121131ef31388e45368dca750a85bbb0574980e2f2532057f462d826d3022a41" exitCode=1 Jun 11 16:09:15.893722 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.893642 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"e9b1d31c7bd714f3b39e8b55b817be9176ac57e77a111b44a71313df07a13b5f"} Jun 11 16:09:15.893722 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.893699 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerDied","Data":"121131ef31388e45368dca750a85bbb0574980e2f2532057f462d826d3022a41"} Jun 11 16:09:15.893801 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.893746 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"a2d49d115a486353a30c55e3afe99318fa43efb76e4b1cc34ff8d7b45db3a209"} Jun 11 16:09:15.902012 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.901958 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bm47z" podStartSLOduration=3.051439524 podStartE2EDuration="21.901946583s" totalImagesPullingTime="18.850507059s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:15.901704709 +0000 UTC m=+22.555676498" watchObservedRunningTime="2026-06-11 16:09:15.901946583 +0000 UTC m=+22.555918384" Jun 11 16:09:15.946104 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.946060 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-7xr7h" podStartSLOduration=4.1074131210000004 podStartE2EDuration="22.946046563s" totalImagesPullingTime="18.838633442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:15.925366568 +0000 UTC m=+22.579338359" watchObservedRunningTime="2026-06-11 16:09:15.946046563 +0000 UTC m=+22.600018354" Jun 11 16:09:15.946418 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.946370 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ntgfl" podStartSLOduration=3.134670804 podStartE2EDuration="21.946359907s" totalImagesPullingTime="18.811689103s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:15.945791736 +0000 UTC m=+22.599763526" watchObservedRunningTime="2026-06-11 16:09:15.946359907 +0000 UTC m=+22.600331696" Jun 11 16:09:15.993006 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:15.992957 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7msjq" podStartSLOduration=4.180110798 podStartE2EDuration="22.992942415s" totalImagesPullingTime="18.812831617s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:15.992758528 +0000 UTC m=+22.646730356" watchObservedRunningTime="2026-06-11 16:09:15.992942415 +0000 UTC m=+22.646914234" Jun 11 16:09:16.008023 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.007984 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-krdfw" podStartSLOduration=4.555088155 podStartE2EDuration="23.007969318s" totalImagesPullingTime="18.452881163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:16.007665721 +0000 UTC m=+22.661637511" watchObservedRunningTime="2026-06-11 16:09:16.007969318 +0000 UTC m=+22.661941099" Jun 11 16:09:16.770169 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.770133 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:16.770624 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:16.770245 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:16.899361 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.899334 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:09:16.899881 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.899846 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"2c9e7bcd65fdaae58ad9824a802f5d1e0e16539167365bf27e9696dae54350c1"} Jun 11 16:09:16.900007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.899952 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"a49bd43372613af95f746c5532519690f5f2ef8d0359240381a264d85afbd8ef"} Jun 11 16:09:16.900007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.900001 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"e1a1e9142143b84c1ad918fb706cfc627dfaa0561e8df9eca9c1f02759f50dd4"} Jun 11 16:09:16.901506 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:16.901464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-h9dp7" event={"ID":"e7c93a39-1a05-45d5-aba4-9a89397d5322","Type":"ContainerStarted","Data":"47a628a90c0901efcfaf65fccdbecb3462dbe95eb0de50e63f49bc23ad12d4da"} Jun 11 16:09:17.717480 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.717442 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 16:09:17.766875 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.766746 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T16:09:17.717464239Z","UUID":"752bacdc-e7b5-43a9-a0a9-141bcf2efdf1","Handler":null,"Name":"","Endpoint":""} Jun 11 16:09:17.768546 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.768526 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 16:09:17.768725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.768574 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 16:09:17.769445 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.769425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:17.769552 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.769425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:17.769608 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:17.769556 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:17.769682 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:17.769657 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:17.905979 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:17.905896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" event={"ID":"33081167-5c97-4e5b-880c-6d485669e4a6","Type":"ContainerStarted","Data":"560c47e6dbe24e2c4c27f7423f90b84922988065de1298008343fa3247353c1e"} Jun 11 16:09:18.581844 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.581652 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:09:18.582255 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.582236 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:09:18.618043 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.617995 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-h9dp7" podStartSLOduration=6.776078686 podStartE2EDuration="25.617976824s" totalImagesPullingTime="18.841898138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:16.92011884 +0000 UTC m=+23.574090632" watchObservedRunningTime="2026-06-11 16:09:18.617976824 +0000 UTC m=+25.271948613" Jun 11 16:09:18.769745 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.769713 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:18.769914 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:18.769816 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:18.912221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.912152 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:09:18.912659 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.912635 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"1278422aab6bc8ad123b2180489aa84e6bfa3ccfdabc41a400f76d91edcc8fe7"} Jun 11 16:09:18.912747 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.912727 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:09:18.913352 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:18.913332 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-krdfw" Jun 11 16:09:19.769787 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:19.769752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:19.769968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:19.769752 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:19.769968 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:19.769903 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:19.769968 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:19.769934 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:19.805261 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:19.805224 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:19.974729 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:19.974696 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:20.770138 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.769979 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:20.770307 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:20.770204 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:20.920975 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.920948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:09:20.921329 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.921310 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"06c32f180d9e47e320c29adb0b5bd19a87ccf7689515dae0826642c904b1308f"} Jun 11 16:09:20.921610 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.921589 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:20.921828 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.921811 2562 scope.go:117] "RemoveContainer" containerID="121131ef31388e45368dca750a85bbb0574980e2f2532057f462d826d3022a41" Jun 11 16:09:20.923421 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.923379 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="f73414c3ceee8e7c1da98b4a6b2c9ec7ad92d30be83ea6705d3d56a6e6367d78" exitCode=0 Jun 11 16:09:20.923526 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.923430 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"f73414c3ceee8e7c1da98b4a6b2c9ec7ad92d30be83ea6705d3d56a6e6367d78"} Jun 11 16:09:20.925736 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.925714 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" event={"ID":"33081167-5c97-4e5b-880c-6d485669e4a6","Type":"ContainerStarted","Data":"14a45108a164228046468a2d967d922a9180973f6e594ceec430cc2bed433f06"} Jun 11 16:09:20.938797 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:20.938775 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:21.096884 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.096774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6ncz" podStartSLOduration=4.815170576 podStartE2EDuration="28.096757274s" totalImagesPullingTime="23.281586698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:21.043524209 +0000 UTC m=+27.697495998" watchObservedRunningTime="2026-06-11 16:09:21.096757274 +0000 UTC m=+27.750729064" Jun 11 16:09:21.770265 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.770231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:21.770446 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:21.770350 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:21.770446 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.770403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:21.770533 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:21.770489 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:21.930958 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.930933 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:09:21.931350 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.931325 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" event={"ID":"7b8489e1-f957-4181-b952-1f28e581006c","Type":"ContainerStarted","Data":"ec687d783b84da7278c987af691e662542f6c7d15521d6b90026db4164b63d91"} Jun 11 16:09:21.931769 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.931747 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:21.931865 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.931818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:21.947402 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.947361 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:21.979973 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:21.979913 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" podStartSLOduration=10.105413084 podStartE2EDuration="28.979898499s" totalImagesPullingTime="18.874485415s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:21.979361418 +0000 UTC m=+28.633333207" watchObservedRunningTime="2026-06-11 16:09:21.979898499 +0000 UTC m=+28.633870307" Jun 11 16:09:22.763459 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.763184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qvvst"] Jun 11 16:09:22.763956 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.763575 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:22.763956 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:22.763693 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:22.765416 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.765374 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5cszm"] Jun 11 16:09:22.765528 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.765512 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:22.765647 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:22.765625 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:22.766021 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.765999 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65bmr"] Jun 11 16:09:22.766125 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.766091 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:22.766197 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:22.766177 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:22.935735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.935657 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="e099f4e3852988413139070525ef0143996fe67ca7625b9a411fab584661024f" exitCode=0 Jun 11 16:09:22.935857 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:22.935744 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"e099f4e3852988413139070525ef0143996fe67ca7625b9a411fab584661024f"} Jun 11 16:09:23.768005 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:23.767973 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:23.861684 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:23.861649 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:23.976022 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:23.975993 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:24.077085 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.077056 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:24.770077 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.770048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:24.770645 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.770048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:24.770645 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:24.770173 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:24.770645 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.770059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:24.770645 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:24.770258 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:24.770645 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:24.770340 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:24.944433 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.944399 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="3b84e6bf134139dc1bdb0c11de6f3a1586619074594039f4b85cffb617f7f758" exitCode=0 Jun 11 16:09:24.944561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:24.944439 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"3b84e6bf134139dc1bdb0c11de6f3a1586619074594039f4b85cffb617f7f758"} Jun 11 16:09:26.770311 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:26.770276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:26.770926 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:26.770276 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:26.770926 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:26.770560 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65bmr" podUID="03d8d392-0a28-41b2-b412-63a46cca2765" Jun 11 16:09:26.770926 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:26.770289 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:26.770926 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:26.770436 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:09:26.770926 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:26.770681 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qvvst" podUID="1742c73f-8da9-4431-aa49-3f9f053a1d05" Jun 11 16:09:27.460152 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:27.460120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:27.460455 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.460288 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:27.460455 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.460374 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:09:59.460349293 +0000 UTC m=+66.114321060 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 16:09:27.561424 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:27.561375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:27.561619 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:27.561491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:27.561619 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561538 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 16:09:27.561619 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561565 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 16:09:27.561619 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561579 2562 projected.go:196] Error preparing data for projected volume kube-api-access-dtzf4 for pod openshift-network-diagnostics/network-check-target-65bmr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:27.561619 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561591 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:27.561852 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561646 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4 podName:03d8d392-0a28-41b2-b412-63a46cca2765 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:59.561624481 +0000 UTC m=+66.215596250 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dtzf4" (UniqueName: "kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4") pod "network-check-target-65bmr" (UID: "03d8d392-0a28-41b2-b412-63a46cca2765") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 16:09:27.561852 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:27.561666 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret podName:1742c73f-8da9-4431-aa49-3f9f053a1d05 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:59.561656389 +0000 UTC m=+66.215628158 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret") pod "global-pull-secret-syncer-qvvst" (UID: "1742c73f-8da9-4431-aa49-3f9f053a1d05") : object "kube-system"/"original-pull-secret" not registered Jun 11 16:09:27.654080 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:27.654044 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:27.758396 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:27.758337 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:28.046172 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.046095 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:28.161372 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.161341 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-8.ec2.internal" event="NodeReady" Jun 11 16:09:28.161564 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.161527 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 16:09:28.221227 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.221195 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7bpl8"] Jun 11 16:09:28.235285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.235253 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pt97z"] Jun 11 16:09:28.235464 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.235363 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.239699 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.239677 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pbxmp\"" Jun 11 16:09:28.241680 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.241657 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 16:09:28.241807 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.241743 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 16:09:28.245524 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.245504 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7bpl8"] Jun 11 16:09:28.245633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.245622 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.249123 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.249099 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pt97z"] Jun 11 16:09:28.251616 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.251592 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 16:09:28.251727 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.251705 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-phqs4\"" Jun 11 16:09:28.257102 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.257080 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 16:09:28.257207 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.257116 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 16:09:28.365779 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365691 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.365779 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365731 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf0f773-9b7a-4510-91ed-1b55d35984a3-tmp-dir\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.365779 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365766 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf0f773-9b7a-4510-91ed-1b55d35984a3-config-volume\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.366022 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365809 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9p9n\" (UniqueName: \"kubernetes.io/projected/8bf0f773-9b7a-4510-91ed-1b55d35984a3-kube-api-access-t9p9n\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.366022 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwfsq\" (UniqueName: \"kubernetes.io/projected/c9544e6f-e857-401e-b430-b5433824da97-kube-api-access-fwfsq\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.366022 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.365903 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9544e6f-e857-401e-b430-b5433824da97-cert\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.466995 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.466959 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf0f773-9b7a-4510-91ed-1b55d35984a3-config-volume\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.466995 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9p9n\" (UniqueName: \"kubernetes.io/projected/8bf0f773-9b7a-4510-91ed-1b55d35984a3-kube-api-access-t9p9n\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.467238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467072 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwfsq\" (UniqueName: \"kubernetes.io/projected/c9544e6f-e857-401e-b430-b5433824da97-kube-api-access-fwfsq\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.467238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9544e6f-e857-401e-b430-b5433824da97-cert\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.467238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.467238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf0f773-9b7a-4510-91ed-1b55d35984a3-tmp-dir\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.467451 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:28.467299 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:28.467451 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:28.467373 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:28.967351023 +0000 UTC m=+35.621322809 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:28.467617 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467593 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8bf0f773-9b7a-4510-91ed-1b55d35984a3-tmp-dir\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.467748 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.467729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8bf0f773-9b7a-4510-91ed-1b55d35984a3-config-volume\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.471723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.471592 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9544e6f-e857-401e-b430-b5433824da97-cert\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.480424 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.480402 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9p9n\" (UniqueName: \"kubernetes.io/projected/8bf0f773-9b7a-4510-91ed-1b55d35984a3-kube-api-access-t9p9n\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.480514 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.480477 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwfsq\" (UniqueName: \"kubernetes.io/projected/c9544e6f-e857-401e-b430-b5433824da97-kube-api-access-fwfsq\") pod \"ingress-canary-pt97z\" (UID: \"c9544e6f-e857-401e-b430-b5433824da97\") " pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.557495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.557464 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pt97z" Jun 11 16:09:28.769681 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.769650 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:28.769837 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.769663 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:28.769837 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.769804 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:28.773934 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.773908 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:09:28.774092 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.774076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:09:28.774199 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.774184 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2w2xq\"" Jun 11 16:09:28.774615 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.774590 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:09:28.774615 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.774611 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:09:28.774830 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.774649 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kx8mw\"" Jun 11 16:09:28.912221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.912191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pt97z"] Jun 11 16:09:28.915630 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:09:28.915606 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9544e6f_e857_401e_b430_b5433824da97.slice/crio-3d698814248530e4918bc35c370a75a06b7228d1d9a6621e300fc83b1191e969 WatchSource:0}: Error finding container 3d698814248530e4918bc35c370a75a06b7228d1d9a6621e300fc83b1191e969: Status 404 returned error can't find the container with id 3d698814248530e4918bc35c370a75a06b7228d1d9a6621e300fc83b1191e969 Jun 11 16:09:28.956013 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.955981 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pt97z" event={"ID":"c9544e6f-e857-401e-b430-b5433824da97","Type":"ContainerStarted","Data":"3d698814248530e4918bc35c370a75a06b7228d1d9a6621e300fc83b1191e969"} Jun 11 16:09:28.958848 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.958816 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerStarted","Data":"3817d79fa61e7fbe588226a96e4fb597e2aac246e2466ded584585ff9e47a947"} Jun 11 16:09:28.980428 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:28.980399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:28.980560 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:28.980498 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:28.980622 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:28.980575 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:29.980552313 +0000 UTC m=+36.634524087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:29.566526 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.566492 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq"] Jun 11 16:09:29.568174 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.568157 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.570241 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.570216 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 11 16:09:29.570241 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.570234 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 11 16:09:29.570424 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.570336 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 11 16:09:29.570424 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.570364 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 11 16:09:29.577700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.577681 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w"] Jun 11 16:09:29.579223 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.579210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.585141 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.585120 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jun 11 16:09:29.585141 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.585131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jun 11 16:09:29.585378 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.585361 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jun 11 16:09:29.585498 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.585480 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jun 11 16:09:29.589533 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.589510 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq"] Jun 11 16:09:29.602929 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.602907 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w"] Jun 11 16:09:29.684985 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.684949 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.685159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.684995 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-tmp\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.685159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685012 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-klusterlet-config\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.685159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685112 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.685159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.685159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685147 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/055cdee5-289d-4943-a1cb-9432b7898b5c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.685463 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zbk\" (UniqueName: \"kubernetes.io/projected/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-kube-api-access-f2zbk\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.685463 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685247 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.685463 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.685310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccg9m\" (UniqueName: \"kubernetes.io/projected/055cdee5-289d-4943-a1cb-9432b7898b5c-kube-api-access-ccg9m\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786396 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786422 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/055cdee5-289d-4943-a1cb-9432b7898b5c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zbk\" (UniqueName: \"kubernetes.io/projected/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-kube-api-access-f2zbk\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786489 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccg9m\" (UniqueName: \"kubernetes.io/projected/055cdee5-289d-4943-a1cb-9432b7898b5c-kube-api-access-ccg9m\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786524 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.786561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786557 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-tmp\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.786906 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-klusterlet-config\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.786995 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.786968 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-tmp\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.787215 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.787179 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/055cdee5-289d-4943-a1cb-9432b7898b5c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.789937 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.789909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-ca\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.790032 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.789972 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.790101 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.790075 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.790210 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.790194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/055cdee5-289d-4943-a1cb-9432b7898b5c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.790249 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.790216 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-klusterlet-config\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.797455 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.797433 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zbk\" (UniqueName: \"kubernetes.io/projected/bdd9c378-b5f1-4fba-b7c4-e363ae77048d-kube-api-access-f2zbk\") pod \"klusterlet-addon-workmgr-685d6dc644-8d6dq\" (UID: \"bdd9c378-b5f1-4fba-b7c4-e363ae77048d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.797795 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.797773 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccg9m\" (UniqueName: \"kubernetes.io/projected/055cdee5-289d-4943-a1cb-9432b7898b5c-kube-api-access-ccg9m\") pod \"cluster-proxy-proxy-agent-7b9996f947-txx8w\" (UID: \"055cdee5-289d-4943-a1cb-9432b7898b5c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.877726 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.877641 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:29.898237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.898210 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:09:29.967935 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.967663 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="3817d79fa61e7fbe588226a96e4fb597e2aac246e2466ded584585ff9e47a947" exitCode=0 Jun 11 16:09:29.967935 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.967755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"3817d79fa61e7fbe588226a96e4fb597e2aac246e2466ded584585ff9e47a947"} Jun 11 16:09:29.987990 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:29.987903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:29.988235 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:29.988130 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:29.988235 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:29.988201 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:31.988179606 +0000 UTC m=+38.642151379 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:30.026580 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.026542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq"] Jun 11 16:09:30.054455 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.054426 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w"] Jun 11 16:09:30.058258 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:09:30.058231 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod055cdee5_289d_4943_a1cb_9432b7898b5c.slice/crio-712765b460a593762ed6b0d7e63a713cb2a6abc6dc09f56b1d173f51a8897a3d WatchSource:0}: Error finding container 712765b460a593762ed6b0d7e63a713cb2a6abc6dc09f56b1d173f51a8897a3d: Status 404 returned error can't find the container with id 712765b460a593762ed6b0d7e63a713cb2a6abc6dc09f56b1d173f51a8897a3d Jun 11 16:09:30.975454 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.975378 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerStarted","Data":"712765b460a593762ed6b0d7e63a713cb2a6abc6dc09f56b1d173f51a8897a3d"} Jun 11 16:09:30.983650 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.983603 2562 generic.go:356] "Generic (PLEG): container finished" podID="4124af47-3674-4853-8fa4-0498e79ebff8" containerID="40fccbac384431a40a057cc8559a1607da4da2e9b00865adc095960a76051aaf" exitCode=0 Jun 11 16:09:30.984075 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.983999 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerDied","Data":"40fccbac384431a40a057cc8559a1607da4da2e9b00865adc095960a76051aaf"} Jun 11 16:09:30.988185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:30.988110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerStarted","Data":"a485e75d2e6131539621ac7cc32e2254a76d16301f8a60d649f8a2386991dfdb"} Jun 11 16:09:31.998279 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:31.998242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" event={"ID":"4124af47-3674-4853-8fa4-0498e79ebff8","Type":"ContainerStarted","Data":"297a2e2d7a3b56b07173fd301d7ad96b2eab85f20d5d3a795a51a8fd986da306"} Jun 11 16:09:32.006999 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.006854 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:32.006999 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:32.006972 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:32.007198 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:32.007039 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:36.007019439 +0000 UTC m=+42.660991220 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:32.034725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.034670 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-8l8nc" podStartSLOduration=9.924373753 podStartE2EDuration="39.034650685s" totalImagesPullingTime="29.110276932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:32.034381092 +0000 UTC m=+38.688352924" watchObservedRunningTime="2026-06-11 16:09:32.034650685 +0000 UTC m=+38.688622475" Jun 11 16:09:32.174381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.174345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:32.241665 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.241623 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:32.853829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.853788 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:32.920219 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:32.920137 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:34.407819 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:34.407774 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:34.526238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:34.526164 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:36.044094 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:36.044055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:36.044472 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:36.044214 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:36.044472 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:36.044276 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:09:44.044260918 +0000 UTC m=+50.698232685 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:37.012748 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.012714 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerStarted","Data":"f9ed2dfaf7aa11fc23824fd706f5948c6568c725be251d2a17e56047489f09f5"} Jun 11 16:09:37.012957 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.012762 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerStarted","Data":"8d6ca99c0dbc34318f3352c47f44514b7b06615eb9025908901102cb9b607f2f"} Jun 11 16:09:37.012957 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.012781 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerStarted","Data":"6d8f50bc46fc8b4f6720d297201fa785ebeab483d51fa040ab7483db68b15932"} Jun 11 16:09:37.014241 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.014215 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pt97z" event={"ID":"c9544e6f-e857-401e-b430-b5433824da97","Type":"ContainerStarted","Data":"060f47edbc84f63f392532d481a523754ab2ed049a40f40a07cd63d6969759c2"} Jun 11 16:09:37.015628 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.015605 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerStarted","Data":"ce83bfd2cea782886c4d9b2c75fd2522221a8e2a8782d6a9356e643b7d8920d8"} Jun 11 16:09:37.015730 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.015716 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:37.017428 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.017404 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:09:37.035415 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.035352 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" podStartSLOduration=1.64387193 podStartE2EDuration="8.035336488s" totalImagesPullingTime="6.391464558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:37.033765188 +0000 UTC m=+43.687736978" watchObservedRunningTime="2026-06-11 16:09:37.035336488 +0000 UTC m=+43.689308271" Jun 11 16:09:37.058991 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.058944 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pt97z" podStartSLOduration=1.524599722 podStartE2EDuration="9.058922929s" totalImagesPullingTime="7.534323207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:37.058804829 +0000 UTC m=+43.712776620" watchObservedRunningTime="2026-06-11 16:09:37.058922929 +0000 UTC m=+43.712894742" Jun 11 16:09:37.101994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:37.101941 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" podStartSLOduration=1.668214981 podStartE2EDuration="8.101924298s" totalImagesPullingTime="6.433709317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:09:37.101378628 +0000 UTC m=+43.755350419" watchObservedRunningTime="2026-06-11 16:09:37.101924298 +0000 UTC m=+43.755896087" Jun 11 16:09:44.100938 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:44.100900 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:09:44.101495 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:44.101046 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:09:44.101495 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:44.101109 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:10:00.101091405 +0000 UTC m=+66.755063178 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:09:45.949515 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:45.949480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:46.049436 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:46.049400 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:53.947718 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:53.947689 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wp94" Jun 11 16:09:54.115878 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:54.115848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:54.246460 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:54.246414 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:54.396302 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:54.396260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:54.465367 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:54.465338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:09:59.514676 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.514640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:09:59.517197 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.517176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 16:09:59.525105 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:59.525088 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:09:59.525177 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:09:59.525145 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:11:03.525128818 +0000 UTC m=+130.179100586 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : secret "metrics-daemon-secret" not found Jun 11 16:09:59.615450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.615423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:59.615565 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.615472 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:59.618097 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.618081 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 16:09:59.618157 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.618137 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 16:09:59.627706 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.627681 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 16:09:59.628284 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.628265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1742c73f-8da9-4431-aa49-3f9f053a1d05-original-pull-secret\") pod \"global-pull-secret-syncer-qvvst\" (UID: \"1742c73f-8da9-4431-aa49-3f9f053a1d05\") " pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:59.638687 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.638661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtzf4\" (UniqueName: \"kubernetes.io/projected/03d8d392-0a28-41b2-b412-63a46cca2765-kube-api-access-dtzf4\") pod \"network-check-target-65bmr\" (UID: \"03d8d392-0a28-41b2-b412-63a46cca2765\") " pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:59.682715 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.682688 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qvvst" Jun 11 16:09:59.694637 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.694617 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2w2xq\"" Jun 11 16:09:59.702736 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.702717 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:09:59.818471 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.818440 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qvvst"] Jun 11 16:09:59.821667 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:09:59.821641 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1742c73f_8da9_4431_aa49_3f9f053a1d05.slice/crio-b1ef9c589eaa76320b961c2b2957a399dc358badca6fec7fdb619df99f4f0f46 WatchSource:0}: Error finding container b1ef9c589eaa76320b961c2b2957a399dc358badca6fec7fdb619df99f4f0f46: Status 404 returned error can't find the container with id b1ef9c589eaa76320b961c2b2957a399dc358badca6fec7fdb619df99f4f0f46 Jun 11 16:09:59.831375 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.831352 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65bmr"] Jun 11 16:09:59.834417 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:09:59.834371 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d8d392_0a28_41b2_b412_63a46cca2765.slice/crio-4a7cb37345b0e1c1a261a131e0f2d42abf0e782fe10da852aed98a3e5a72498d WatchSource:0}: Error finding container 4a7cb37345b0e1c1a261a131e0f2d42abf0e782fe10da852aed98a3e5a72498d: Status 404 returned error can't find the container with id 4a7cb37345b0e1c1a261a131e0f2d42abf0e782fe10da852aed98a3e5a72498d Jun 11 16:09:59.967964 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:09:59.967923 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:10:00.069082 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:00.068987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:10:00.071745 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:00.071713 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qvvst" event={"ID":"1742c73f-8da9-4431-aa49-3f9f053a1d05","Type":"ContainerStarted","Data":"b1ef9c589eaa76320b961c2b2957a399dc358badca6fec7fdb619df99f4f0f46"} Jun 11 16:10:00.072799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:00.072778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65bmr" event={"ID":"03d8d392-0a28-41b2-b412-63a46cca2765","Type":"ContainerStarted","Data":"4a7cb37345b0e1c1a261a131e0f2d42abf0e782fe10da852aed98a3e5a72498d"} Jun 11 16:10:00.119342 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:00.119306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:10:00.119496 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:10:00.119478 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:10:00.119553 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:10:00.119543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:10:32.119527286 +0000 UTC m=+98.773499055 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:10:05.089234 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:05.089189 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qvvst" event={"ID":"1742c73f-8da9-4431-aa49-3f9f053a1d05","Type":"ContainerStarted","Data":"48124baf6e1b0a77b95faefa95f8c09acc463e75f9365c9bdc7f04e9c9e95c0a"} Jun 11 16:10:05.090603 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:05.090576 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65bmr" event={"ID":"03d8d392-0a28-41b2-b412-63a46cca2765","Type":"ContainerStarted","Data":"5b423edf0f16b97d871d0ae2637e823263c5171862ea61582164fb24818ba761"} Jun 11 16:10:05.090717 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:05.090690 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:10:05.105560 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:05.105519 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qvvst" podStartSLOduration=66.368061554 podStartE2EDuration="1m11.105505666s" totalImagesPullingTime="4.737444112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:10:05.104637655 +0000 UTC m=+71.758609444" watchObservedRunningTime="2026-06-11 16:10:05.105505666 +0000 UTC m=+71.759477456" Jun 11 16:10:05.121855 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:05.121815 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-65bmr" podStartSLOduration=67.401225687 podStartE2EDuration="1m12.121802197s" totalImagesPullingTime="4.72057651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:10:05.121375809 +0000 UTC m=+71.775347600" watchObservedRunningTime="2026-06-11 16:10:05.121802197 +0000 UTC m=+71.775773986" Jun 11 16:10:32.142869 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:32.142732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:10:32.143350 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:10:32.142880 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:10:32.143350 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:10:32.142963 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:11:36.142942038 +0000 UTC m=+162.796913820 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:10:35.992680 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:35.992647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:10:36.095792 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:10:36.095763 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-65bmr" Jun 11 16:11:03.561947 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:03.561904 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:11:03.562453 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:03.562052 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:11:03.562453 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:03.562120 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:13:05.562102656 +0000 UTC m=+252.216074424 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : secret "metrics-daemon-secret" not found Jun 11 16:11:31.248308 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:31.248265 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7bpl8" podUID="8bf0f773-9b7a-4510-91ed-1b55d35984a3" Jun 11 16:11:31.334703 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:31.334672 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:11:31.799470 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:31.799428 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:11:35.469557 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:35.469522 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:11:36.192234 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:36.192150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:11:36.192379 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:36.192302 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 16:11:36.192379 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:11:36.192373 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls podName:8bf0f773-9b7a-4510-91ed-1b55d35984a3 nodeName:}" failed. No retries permitted until 2026-06-11 16:13:38.192356289 +0000 UTC m=+284.846328063 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls") pod "dns-default-7bpl8" (UID: "8bf0f773-9b7a-4510-91ed-1b55d35984a3") : secret "dns-default-metrics-tls" not found Jun 11 16:11:37.016745 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:37.016695 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" podUID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.8:8000/readyz\": dial tcp 10.133.0.8:8000: connect: connection refused" Jun 11 16:11:37.351994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:37.351908 2562 generic.go:356] "Generic (PLEG): container finished" podID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" containerID="ce83bfd2cea782886c4d9b2c75fd2522221a8e2a8782d6a9356e643b7d8920d8" exitCode=1 Jun 11 16:11:37.352155 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:37.351986 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerDied","Data":"ce83bfd2cea782886c4d9b2c75fd2522221a8e2a8782d6a9356e643b7d8920d8"} Jun 11 16:11:37.352406 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:37.352374 2562 scope.go:117] "RemoveContainer" containerID="ce83bfd2cea782886c4d9b2c75fd2522221a8e2a8782d6a9356e643b7d8920d8" Jun 11 16:11:38.356914 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:38.356877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerStarted","Data":"7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3"} Jun 11 16:11:38.357353 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:38.357169 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:11:38.357780 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:38.357763 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:11:46.436523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:46.436489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:11:46.770145 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:11:46.770113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:12:32.100525 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:12:32.100491 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:12:32.200854 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:12:32.200818 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:12:59.760616 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:12:59.760577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:12:59.880537 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:12:59.880502 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:01.892920 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:01.892885 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:01.962693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:01.962660 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:04.634920 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:04.634879 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:04.956682 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:04.956602 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:05.189499 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:05.189466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:05.537216 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:05.537182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:05.614581 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:05.614553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:13:05.614726 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:05.614699 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 16:13:05.614763 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:05.614758 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs podName:ef8579aa-025c-4bc3-b190-6610c84e8feb nodeName:}" failed. No retries permitted until 2026-06-11 16:15:07.614741149 +0000 UTC m=+374.268712920 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs") pod "network-metrics-daemon-5cszm" (UID: "ef8579aa-025c-4bc3-b190-6610c84e8feb") : secret "metrics-daemon-secret" not found Jun 11 16:13:05.750664 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:05.750628 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:05.865365 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:05.865283 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:07.443963 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:07.443933 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:07.551807 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:07.551775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:08.640019 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:08.639987 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntgfl_2763331e-e015-4d97-a700-f8333064921e/dns-node-resolver/0.log" Jun 11 16:13:09.074500 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:09.074470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:09.229215 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:09.229191 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7msjq_70bd67a7-9c07-4bbc-a261-8da7f252bc91/node-ca/0.log" Jun 11 16:13:09.387337 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:09.387263 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:09.581223 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:09.581187 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:09.739438 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:09.739407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:10.439446 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:10.439419 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pt97z_c9544e6f-e857-401e-b430-b5433824da97/serve-healthcheck-canary/0.log" Jun 11 16:13:10.493722 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:10.493690 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:11.017995 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:11.017959 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:11.206697 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:11.206670 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:11.447066 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:11.446987 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:11.818227 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:11.818194 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:12.192573 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:12.192490 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:12.999814 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:12.999786 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:13.099642 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:13.099604 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:13.200885 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:13.200851 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:13.399629 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:13.399547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:13.600439 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:13.600408 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:13.813649 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:13.813625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:14.211986 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:14.211903 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:14.860633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:14.860594 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:15.214610 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:15.214521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:15.309786 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:15.309754 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:15.621655 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:15.621625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:15.845661 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:15.845624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:16.155370 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:16.155330 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:16.261161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:16.261129 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:16.900398 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:16.900356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:17.257872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:17.257841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:17.436584 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:17.436548 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:17.582711 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:17.582627 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:17.815969 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:17.815938 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:18.444264 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:18.444232 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:19.003476 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:19.003443 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:19.200773 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:19.200734 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:19.409825 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:19.409741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:19.848543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:19.848514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:20.045625 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:20.045592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:21.282052 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:21.282016 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:27.609611 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:27.609571 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:27.697917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:27.697886 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:30.266625 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.266590 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pqtvf"] Jun 11 16:13:30.269645 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.269623 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.278793 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.278776 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 16:13:30.279453 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.279416 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 16:13:30.279622 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.279540 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 16:13:30.279931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.279913 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-sksvz\"" Jun 11 16:13:30.282004 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.281986 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 16:13:30.289121 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.289103 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twgdh\" (UniqueName: \"kubernetes.io/projected/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-api-access-twgdh\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.289209 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.289135 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.289209 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.289174 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-data-volume\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.289209 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.289201 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.289360 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.289293 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-crio-socket\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.302931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.302900 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqtvf"] Jun 11 16:13:30.389867 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.389817 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-crio-socket\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.389867 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.389878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twgdh\" (UniqueName: \"kubernetes.io/projected/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-api-access-twgdh\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390081 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.389956 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-crio-socket\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390081 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.390006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390081 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.390042 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-data-volume\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390081 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.390058 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390458 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.390441 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-data-volume\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.390663 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.390640 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.392734 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.392709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.432743 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.432713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twgdh\" (UniqueName: \"kubernetes.io/projected/d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c-kube-api-access-twgdh\") pod \"insights-runtime-extractor-pqtvf\" (UID: \"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c\") " pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.462731 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.462699 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:30.578863 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.578793 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pqtvf" Jun 11 16:13:30.583535 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.583512 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:30.713784 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:30.713757 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pqtvf"] Jun 11 16:13:30.716161 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:30.716136 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9aa9b93_5892_4f3c_99d8_11f5a6fc8d3c.slice/crio-0823c93ad1ab58087c79523df779f08ba1436936a9fb83b07885f1dc3c720701 WatchSource:0}: Error finding container 0823c93ad1ab58087c79523df779f08ba1436936a9fb83b07885f1dc3c720701: Status 404 returned error can't find the container with id 0823c93ad1ab58087c79523df779f08ba1436936a9fb83b07885f1dc3c720701 Jun 11 16:13:31.687968 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:31.687935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqtvf" event={"ID":"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c","Type":"ContainerStarted","Data":"54d69c47e541dcc6f4ca1a2985651684da289509051eb7ef21335fa46332ecae"} Jun 11 16:13:31.688325 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:31.687988 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqtvf" event={"ID":"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c","Type":"ContainerStarted","Data":"c4929550aabce093d4cc4497054cdf633749e453be7019407f09fd223f41539c"} Jun 11 16:13:31.688325 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:31.688008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqtvf" event={"ID":"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c","Type":"ContainerStarted","Data":"0823c93ad1ab58087c79523df779f08ba1436936a9fb83b07885f1dc3c720701"} Jun 11 16:13:33.698034 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:33.697935 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pqtvf" event={"ID":"d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c","Type":"ContainerStarted","Data":"de310aa6285058b1ee8997dd2be33434beb90d47c5c0c97855d9c53055b6a467"} Jun 11 16:13:33.715560 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:33.715492 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pqtvf" podStartSLOduration=1.150071136 podStartE2EDuration="3.715472328s" totalImagesPullingTime="2.565401192s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:13:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:33.714814845 +0000 UTC m=+280.368786636" watchObservedRunningTime="2026-06-11 16:13:33.715472328 +0000 UTC m=+280.369444207" Jun 11 16:13:34.335890 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:34.335851 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7bpl8" podUID="8bf0f773-9b7a-4510-91ed-1b55d35984a3" Jun 11 16:13:34.700930 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:34.700847 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:34.878405 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:34.878355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:34.993670 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:34.993641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:35.070302 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.070272 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67"] Jun 11 16:13:35.071272 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.071250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:35.073115 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.073100 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:35.075044 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.075026 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 11 16:13:35.075129 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.075033 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-f54js\"" Jun 11 16:13:35.086574 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.086536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67"] Jun 11 16:13:35.124942 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.124901 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fql67\" (UID: \"62d896e2-9b1f-4237-8b07-68bd96709935\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:35.138060 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.138029 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:35.201951 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.201922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:35.226150 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.226123 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fql67\" (UID: \"62d896e2-9b1f-4237-8b07-68bd96709935\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:35.226284 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:35.226268 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:13:35.226349 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:35.226338 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates podName:62d896e2-9b1f-4237-8b07-68bd96709935 nodeName:}" failed. No retries permitted until 2026-06-11 16:13:35.726317708 +0000 UTC m=+282.380289480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates") pod "prometheus-operator-admission-webhook-5b6b8f594-fql67" (UID: "62d896e2-9b1f-4237-8b07-68bd96709935") : secret "prometheus-operator-admission-webhook-tls" not found Jun 11 16:13:35.550749 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.550716 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:35.729802 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.729761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fql67\" (UID: \"62d896e2-9b1f-4237-8b07-68bd96709935\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:35.732157 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.732138 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/62d896e2-9b1f-4237-8b07-68bd96709935-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-fql67\" (UID: \"62d896e2-9b1f-4237-8b07-68bd96709935\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:35.984794 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:35.984767 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:36.105876 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:36.105846 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67"] Jun 11 16:13:36.108934 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:36.108904 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62d896e2_9b1f_4237_8b07_68bd96709935.slice/crio-972037428ab9c62ab943c83c5b9560130a1ac397bf9e5755aafbfda3fc94b61a WatchSource:0}: Error finding container 972037428ab9c62ab943c83c5b9560130a1ac397bf9e5755aafbfda3fc94b61a: Status 404 returned error can't find the container with id 972037428ab9c62ab943c83c5b9560130a1ac397bf9e5755aafbfda3fc94b61a Jun 11 16:13:36.708165 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:36.708128 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" event={"ID":"62d896e2-9b1f-4237-8b07-68bd96709935","Type":"ContainerStarted","Data":"972037428ab9c62ab943c83c5b9560130a1ac397bf9e5755aafbfda3fc94b61a"} Jun 11 16:13:37.713055 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.712976 2562 generic.go:356] "Generic (PLEG): container finished" podID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" containerID="7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3" exitCode=1 Jun 11 16:13:37.713511 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.713049 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerDied","Data":"7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3"} Jun 11 16:13:37.713511 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.713108 2562 scope.go:117] "RemoveContainer" containerID="ce83bfd2cea782886c4d9b2c75fd2522221a8e2a8782d6a9356e643b7d8920d8" Jun 11 16:13:37.713511 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.713422 2562 scope.go:117] "RemoveContainer" containerID="7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3" Jun 11 16:13:37.713669 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:37.713622 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-685d6dc644-8d6dq_open-cluster-management-agent-addon(bdd9c378-b5f1-4fba-b7c4-e363ae77048d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" podUID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" Jun 11 16:13:37.714561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.714535 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" event={"ID":"62d896e2-9b1f-4237-8b07-68bd96709935","Type":"ContainerStarted","Data":"41c1dfe8b06879e90f5f298b08fc8db8b5dbf418c6c50f78f493ab6f01f4c786"} Jun 11 16:13:37.714746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.714728 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:37.719380 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.719356 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" Jun 11 16:13:37.772051 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:37.772007 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-fql67" podStartSLOduration=1.51250079 podStartE2EDuration="2.771993627s" totalImagesPullingTime="1.259492837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:37.770999637 +0000 UTC m=+284.424971427" watchObservedRunningTime="2026-06-11 16:13:37.771993627 +0000 UTC m=+284.425965416" Jun 11 16:13:38.103625 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.103588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:38.239079 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.239051 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:38.250958 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.250934 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:38.253194 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.253164 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8bf0f773-9b7a-4510-91ed-1b55d35984a3-metrics-tls\") pod \"dns-default-7bpl8\" (UID: \"8bf0f773-9b7a-4510-91ed-1b55d35984a3\") " pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:38.304931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.304905 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pbxmp\"" Jun 11 16:13:38.313198 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.313182 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:38.357629 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.357538 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:13:38.444696 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.444307 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7bpl8"] Jun 11 16:13:38.446983 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:38.446953 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf0f773_9b7a_4510_91ed_1b55d35984a3.slice/crio-937390392c814cc182136afc12333d539e83491b165d0d2ac38ca6c3224c2ec4 WatchSource:0}: Error finding container 937390392c814cc182136afc12333d539e83491b165d0d2ac38ca6c3224c2ec4: Status 404 returned error can't find the container with id 937390392c814cc182136afc12333d539e83491b165d0d2ac38ca6c3224c2ec4 Jun 11 16:13:38.719432 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.719318 2562 scope.go:117] "RemoveContainer" containerID="7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3" Jun 11 16:13:38.719838 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:38.719507 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-685d6dc644-8d6dq_open-cluster-management-agent-addon(bdd9c378-b5f1-4fba-b7c4-e363ae77048d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" podUID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" Jun 11 16:13:38.720260 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.720242 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7bpl8" event={"ID":"8bf0f773-9b7a-4510-91ed-1b55d35984a3","Type":"ContainerStarted","Data":"937390392c814cc182136afc12333d539e83491b165d0d2ac38ca6c3224c2ec4"} Jun 11 16:13:38.995600 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:38.995562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:39.877796 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:39.877759 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:13:39.878220 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:39.878129 2562 scope.go:117] "RemoveContainer" containerID="7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3" Jun 11 16:13:39.878287 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:39.878268 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-685d6dc644-8d6dq_open-cluster-management-agent-addon(bdd9c378-b5f1-4fba-b7c4-e363ae77048d)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" podUID="bdd9c378-b5f1-4fba-b7c4-e363ae77048d" Jun 11 16:13:39.899903 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:39.899862 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" podUID="055cdee5-289d-4943-a1cb-9432b7898b5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:13:40.728523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:40.728435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7bpl8" event={"ID":"8bf0f773-9b7a-4510-91ed-1b55d35984a3","Type":"ContainerStarted","Data":"04a0c884ba45b9fe037576d8d7bca2a8a3af1ce18e204fd088095b6a1e353406"} Jun 11 16:13:40.728523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:40.728488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7bpl8" event={"ID":"8bf0f773-9b7a-4510-91ed-1b55d35984a3","Type":"ContainerStarted","Data":"bb9d59ce3a9dc54876f56f23079b92bb3e3a6bdc9dfce727b72310828b0f2685"} Jun 11 16:13:40.728692 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:40.728593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:40.763824 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:40.763768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7bpl8" podStartSLOduration=250.869702223 podStartE2EDuration="4m12.763750917s" totalImagesPullingTime="1.894048694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:09:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:40.762901085 +0000 UTC m=+287.416872900" watchObservedRunningTime="2026-06-11 16:13:40.763750917 +0000 UTC m=+287.417722709" Jun 11 16:13:40.969405 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:40.969355 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:43.253925 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.253869 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:43.507008 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.506919 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:43.555372 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.555332 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m"] Jun 11 16:13:43.558633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.558611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.561760 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.561737 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 16:13:43.561902 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.561800 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nbvlx\"" Jun 11 16:13:43.562299 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.562279 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 16:13:43.562299 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.562292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 16:13:43.562469 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.562305 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 16:13:43.562590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.562573 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 16:13:43.575710 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.575685 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m"] Jun 11 16:13:43.588606 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.588584 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bxq77"] Jun 11 16:13:43.591458 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.591438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.593318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.593300 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 16:13:43.593430 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.593353 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 16:13:43.593773 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.593757 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 16:13:43.593773 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.593764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xfzx2\"" Jun 11 16:13:43.594010 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.593994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.594051 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.594020 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.594051 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.594043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b1f79d-7c4e-4663-be54-477b672cd8b0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.594126 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.594066 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sltww\" (UniqueName: \"kubernetes.io/projected/66b1f79d-7c4e-4663-be54-477b672cd8b0-kube-api-access-sltww\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.613338 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.613280 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:43.694970 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.694934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-metrics-client-ca\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.694970 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.694971 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.694996 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-textfile\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-root\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695085 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695115 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695134 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hmcf\" (UniqueName: \"kubernetes.io/projected/43d68a21-c22b-4950-8f0c-82ee1187b5d2-kube-api-access-4hmcf\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695157 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-wtmp\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-sys\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695256 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b1f79d-7c4e-4663-be54-477b672cd8b0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695331 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695380 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sltww\" (UniqueName: \"kubernetes.io/projected/66b1f79d-7c4e-4663-be54-477b672cd8b0-kube-api-access-sltww\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.695501 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:43.695480 2562 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 16:13:43.695792 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:43.695533 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls podName:66b1f79d-7c4e-4663-be54-477b672cd8b0 nodeName:}" failed. No retries permitted until 2026-06-11 16:13:44.19551953 +0000 UTC m=+290.849491301 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-djg4m" (UID: "66b1f79d-7c4e-4663-be54-477b672cd8b0") : secret "openshift-state-metrics-tls" not found Jun 11 16:13:43.695917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.695898 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66b1f79d-7c4e-4663-be54-477b672cd8b0-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.697691 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.697667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.715621 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.715601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sltww\" (UniqueName: \"kubernetes.io/projected/66b1f79d-7c4e-4663-be54-477b672cd8b0-kube-api-access-sltww\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:43.737113 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.737084 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:43.796634 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796549 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-root\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796634 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796634 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796634 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796621 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hmcf\" (UniqueName: \"kubernetes.io/projected/43d68a21-c22b-4950-8f0c-82ee1187b5d2-kube-api-access-4hmcf\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796641 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-wtmp\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796668 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-sys\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-root\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796723 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-metrics-client-ca\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796783 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-textfile\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796783 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-wtmp\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.796793 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/43d68a21-c22b-4950-8f0c-82ee1187b5d2-sys\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.796927 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:43.796876 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 16:13:43.797223 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:43.796941 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls podName:43d68a21-c22b-4950-8f0c-82ee1187b5d2 nodeName:}" failed. No retries permitted until 2026-06-11 16:13:44.296923735 +0000 UTC m=+290.950895512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls") pod "node-exporter-bxq77" (UID: "43d68a21-c22b-4950-8f0c-82ee1187b5d2") : secret "node-exporter-tls" not found Jun 11 16:13:43.797223 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.797109 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-textfile\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.797304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.797237 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.797304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.797260 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/43d68a21-c22b-4950-8f0c-82ee1187b5d2-metrics-client-ca\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.799150 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.799128 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.811158 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.811133 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hmcf\" (UniqueName: \"kubernetes.io/projected/43d68a21-c22b-4950-8f0c-82ee1187b5d2-kube-api-access-4hmcf\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:43.911101 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:43.911067 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.005621 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.005585 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.106147 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.106064 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.200268 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.200223 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:44.203611 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.203575 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66b1f79d-7c4e-4663-be54-477b672cd8b0-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-djg4m\" (UID: \"66b1f79d-7c4e-4663-be54-477b672cd8b0\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:44.208212 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.208185 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.301077 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.301046 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:44.303246 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.303225 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/43d68a21-c22b-4950-8f0c-82ee1187b5d2-node-exporter-tls\") pod \"node-exporter-bxq77\" (UID: \"43d68a21-c22b-4950-8f0c-82ee1187b5d2\") " pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:44.414309 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.414201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.467171 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.467141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" Jun 11 16:13:44.500298 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.500260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bxq77" Jun 11 16:13:44.512544 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:44.512501 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43d68a21_c22b_4950_8f0c_82ee1187b5d2.slice/crio-e4d7d9de26b62f20b8ae24b94bd26881e7f4f10116da7ddceb1754062330256b WatchSource:0}: Error finding container e4d7d9de26b62f20b8ae24b94bd26881e7f4f10116da7ddceb1754062330256b: Status 404 returned error can't find the container with id e4d7d9de26b62f20b8ae24b94bd26881e7f4f10116da7ddceb1754062330256b Jun 11 16:13:44.521278 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.521209 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.612906 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.612875 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m"] Jun 11 16:13:44.617161 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:44.617130 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66b1f79d_7c4e_4663_be54_477b672cd8b0.slice/crio-a0a4f9beaff380acdebe7d878e31ade40b6f832c285e99fb1e4148570e59d4b2 WatchSource:0}: Error finding container a0a4f9beaff380acdebe7d878e31ade40b6f832c285e99fb1e4148570e59d4b2: Status 404 returned error can't find the container with id a0a4f9beaff380acdebe7d878e31ade40b6f832c285e99fb1e4148570e59d4b2 Jun 11 16:13:44.644813 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.644789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.741836 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.741808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxq77" event={"ID":"43d68a21-c22b-4950-8f0c-82ee1187b5d2","Type":"ContainerStarted","Data":"e4d7d9de26b62f20b8ae24b94bd26881e7f4f10116da7ddceb1754062330256b"} Jun 11 16:13:44.743459 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.743435 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" event={"ID":"66b1f79d-7c4e-4663-be54-477b672cd8b0","Type":"ContainerStarted","Data":"060caeb46d87ccc2f6c7b73bf62ef6b6197d10f7cbffd11614974867cf3cb0ab"} Jun 11 16:13:44.743542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.743491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" event={"ID":"66b1f79d-7c4e-4663-be54-477b672cd8b0","Type":"ContainerStarted","Data":"a0a4f9beaff380acdebe7d878e31ade40b6f832c285e99fb1e4148570e59d4b2"} Jun 11 16:13:44.776642 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.776614 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:44.939053 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:44.938964 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.039300 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.039257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.117486 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.117446 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.456172 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.456141 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.631565 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.631526 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.697931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.697844 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.748588 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.748561 2562 generic.go:356] "Generic (PLEG): container finished" podID="43d68a21-c22b-4950-8f0c-82ee1187b5d2" containerID="9aea1c7a74813e213f9f36ae23b210dfbf2e9334b22fe57148904aa2a77bd67f" exitCode=0 Jun 11 16:13:45.748785 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.748658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxq77" event={"ID":"43d68a21-c22b-4950-8f0c-82ee1187b5d2","Type":"ContainerDied","Data":"9aea1c7a74813e213f9f36ae23b210dfbf2e9334b22fe57148904aa2a77bd67f"} Jun 11 16:13:45.750452 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.750431 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" event={"ID":"66b1f79d-7c4e-4663-be54-477b672cd8b0","Type":"ContainerStarted","Data":"7c78f8b4909d59f645f150583640582ef25d13f5a83b82abc4dd65a81bd10da1"} Jun 11 16:13:45.820245 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.820215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:45.916490 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:45.916459 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:46.755998 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:46.755959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" event={"ID":"66b1f79d-7c4e-4663-be54-477b672cd8b0","Type":"ContainerStarted","Data":"eacbc9b51965d1e0166887630b72cc65ee85ca0ceb279918bbaf836bca76de40"} Jun 11 16:13:46.758094 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:46.758071 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxq77" event={"ID":"43d68a21-c22b-4950-8f0c-82ee1187b5d2","Type":"ContainerStarted","Data":"d2c67611a9059a180d9b4357f2a671108bc285a46e636a00480c28d248c251e9"} Jun 11 16:13:46.758209 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:46.758111 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bxq77" event={"ID":"43d68a21-c22b-4950-8f0c-82ee1187b5d2","Type":"ContainerStarted","Data":"9f7ba1b5e55316d8a71c311f502eae76d329c9957bad58a02069e609778beca6"} Jun 11 16:13:46.782407 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:46.782083 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-djg4m" podStartSLOduration=2.419295743 podStartE2EDuration="3.782064385s" totalImagesPullingTime="1.362768642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:46.779285427 +0000 UTC m=+293.433257218" watchObservedRunningTime="2026-06-11 16:13:46.782064385 +0000 UTC m=+293.436036176" Jun 11 16:13:46.803679 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:46.803632 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bxq77" podStartSLOduration=2.83250005 podStartE2EDuration="3.803618311s" totalImagesPullingTime="906.227284ms" totalInitContainerRuntime="64.890977ms" isStatefulPod=true podCreationTimestamp="2026-06-11 16:13:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:46.802672485 +0000 UTC m=+293.456644276" watchObservedRunningTime="2026-06-11 16:13:46.803618311 +0000 UTC m=+293.457590101" Jun 11 16:13:47.039230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.039149 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:47.137649 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.137619 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:47.947222 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.947192 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-78b865899-vf4ml"] Jun 11 16:13:47.950144 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.950129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:47.953847 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.953825 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-559mm8a6u4fm8\"" Jun 11 16:13:47.953978 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.953907 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 11 16:13:47.954045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.953978 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-x77pd\"" Jun 11 16:13:47.954045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.954011 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 11 16:13:47.954045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.954034 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 11 16:13:47.954171 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.954136 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 16:13:47.964468 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:47.964445 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78b865899-vf4ml"] Jun 11 16:13:48.036521 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-tls\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-metrics-server-audit-profiles\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtmpj\" (UniqueName: \"kubernetes.io/projected/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-kube-api-access-jtmpj\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036641 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-client-certs\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036664 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-client-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.036693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.036681 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-audit-log\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137493 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-client-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137493 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-audit-log\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137672 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137515 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-tls\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137672 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-metrics-server-audit-profiles\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137672 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137605 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137672 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtmpj\" (UniqueName: \"kubernetes.io/projected/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-kube-api-access-jtmpj\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137672 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137666 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-client-certs\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.137950 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.137926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-audit-log\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.138330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.138306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.138781 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.138753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-metrics-server-audit-profiles\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.140093 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.140074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-client-certs\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.140171 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.140135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-secret-metrics-server-tls\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.140230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.140174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-client-ca-bundle\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.152235 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.152214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtmpj\" (UniqueName: \"kubernetes.io/projected/4f3e6b0c-85ad-4179-89f7-dd6f1b143614-kube-api-access-jtmpj\") pod \"metrics-server-78b865899-vf4ml\" (UID: \"4f3e6b0c-85ad-4179-89f7-dd6f1b143614\") " pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.258615 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.258586 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:13:48.332263 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.332231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:48.401782 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.401727 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-78b865899-vf4ml"] Jun 11 16:13:48.405465 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:48.405430 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f3e6b0c_85ad_4179_89f7_dd6f1b143614.slice/crio-716b9db672d5cbdaee5e41d522114f8955e1bfb5dfa9dcc0e8dd4148cddfef64 WatchSource:0}: Error finding container 716b9db672d5cbdaee5e41d522114f8955e1bfb5dfa9dcc0e8dd4148cddfef64: Status 404 returned error can't find the container with id 716b9db672d5cbdaee5e41d522114f8955e1bfb5dfa9dcc0e8dd4148cddfef64 Jun 11 16:13:48.439042 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.438996 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:48.765830 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.765798 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" event={"ID":"4f3e6b0c-85ad-4179-89f7-dd6f1b143614","Type":"ContainerStarted","Data":"716b9db672d5cbdaee5e41d522114f8955e1bfb5dfa9dcc0e8dd4148cddfef64"} Jun 11 16:13:48.968487 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:48.968457 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:49.771007 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:13:49.770972 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5cszm" podUID="ef8579aa-025c-4bc3-b190-6610c84e8feb" Jun 11 16:13:49.899870 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:49.899825 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" podUID="055cdee5-289d-4943-a1cb-9432b7898b5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:13:49.904014 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:49.903976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:50.734514 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:50.734484 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7bpl8" Jun 11 16:13:50.774590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:50.774558 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" event={"ID":"4f3e6b0c-85ad-4179-89f7-dd6f1b143614","Type":"ContainerStarted","Data":"ed542b51cd67cb0dd6cbdabdf372ac105d63968f6f99ba9c8c03e67f95cc5cb7"} Jun 11 16:13:50.847645 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:50.847587 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" podStartSLOduration=2.050900757 podStartE2EDuration="3.847567606s" totalImagesPullingTime="1.796666849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:50.847279475 +0000 UTC m=+297.501251278" watchObservedRunningTime="2026-06-11 16:13:50.847567606 +0000 UTC m=+297.501539452" Jun 11 16:13:51.085978 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:51.085897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:51.210292 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:51.210242 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:51.310604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:51.310568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:51.657912 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:51.657880 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:51.728948 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:51.728905 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:52.653806 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.653773 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:52.723983 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.723955 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:52.844089 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.844055 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:13:52.847133 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.847116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.849219 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.849197 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 11 16:13:52.849884 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.849868 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-vbwbr\"" Jun 11 16:13:52.850094 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850072 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 11 16:13:52.850094 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850093 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 16:13:52.850322 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850303 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 11 16:13:52.850403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 11 16:13:52.850477 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850428 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 11 16:13:52.850589 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.850569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 16:13:52.858923 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.858904 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:13:52.977739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9kd\" (UniqueName: \"kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.977739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977688 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.977739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977708 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.977983 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977742 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.977983 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977785 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:52.977983 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:52.977863 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.040660 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.040625 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:53.078373 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078346 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.078534 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.078590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9kd\" (UniqueName: \"kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.078628 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078607 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.078661 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.078705 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.078676 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.079148 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.079115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.079256 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.079197 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.079327 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.079272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.080927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.080896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.081049 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.081021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.088802 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.088776 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9kd\" (UniqueName: \"kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd\") pod \"console-7b5554b5cf-xwhfk\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.139360 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.139327 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:53.156327 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.156297 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:13:53.284241 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.284208 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:13:53.287209 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:13:53.287173 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd51ce6a1_20db_415b_bb19_fd04110a8ade.slice/crio-217b0b7a2e666ce3ec41f68c88f7cafa312093c86bf56d4f8ca9d39c95bb7690 WatchSource:0}: Error finding container 217b0b7a2e666ce3ec41f68c88f7cafa312093c86bf56d4f8ca9d39c95bb7690: Status 404 returned error can't find the container with id 217b0b7a2e666ce3ec41f68c88f7cafa312093c86bf56d4f8ca9d39c95bb7690 Jun 11 16:13:53.373760 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.373726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:53.641926 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.641849 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:53.694144 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.694112 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:53.719930 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.716105 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:13:53.719930 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.716168 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:13:53.724838 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.724808 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 16:13:53.771770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.771637 2562 scope.go:117] "RemoveContainer" containerID="7c9e7db14b0f4b7e2faded157edeaf8714f31409686909ce7825be04696a32f3" Jun 11 16:13:53.803982 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:53.785438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5554b5cf-xwhfk" event={"ID":"d51ce6a1-20db-415b-bb19-fd04110a8ade","Type":"ContainerStarted","Data":"217b0b7a2e666ce3ec41f68c88f7cafa312093c86bf56d4f8ca9d39c95bb7690"} Jun 11 16:13:54.792238 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:54.792203 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" event={"ID":"bdd9c378-b5f1-4fba-b7c4-e363ae77048d","Type":"ContainerStarted","Data":"a16b344531501306a963ed39c061b4b1db488386060302a4c71cc5d6c12215e4"} Jun 11 16:13:54.792721 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:54.792533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:13:54.794264 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:54.794234 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-685d6dc644-8d6dq" Jun 11 16:13:56.234185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:56.234154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:56.296695 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:56.296664 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:13:57.810164 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:57.810126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5554b5cf-xwhfk" event={"ID":"d51ce6a1-20db-415b-bb19-fd04110a8ade","Type":"ContainerStarted","Data":"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621"} Jun 11 16:13:57.838760 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:57.838712 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b5554b5cf-xwhfk" podStartSLOduration=1.829692128 podStartE2EDuration="5.838698394s" totalImagesPullingTime="4.009006266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:13:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:13:57.835948295 +0000 UTC m=+304.489920106" watchObservedRunningTime="2026-06-11 16:13:57.838698394 +0000 UTC m=+304.492670183" Jun 11 16:13:59.899270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:59.899227 2562 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" podUID="055cdee5-289d-4943-a1cb-9432b7898b5c" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Jun 11 16:13:59.899692 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:59.899294 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" Jun 11 16:13:59.899834 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:59.899803 2562 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"f9ed2dfaf7aa11fc23824fd706f5948c6568c725be251d2a17e56047489f09f5"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" containerMessage="Container service-proxy failed liveness probe, will be restarted" Jun 11 16:13:59.899871 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:13:59.899854 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" podUID="055cdee5-289d-4943-a1cb-9432b7898b5c" containerName="service-proxy" containerID="cri-o://f9ed2dfaf7aa11fc23824fd706f5948c6568c725be251d2a17e56047489f09f5" gracePeriod=30 Jun 11 16:14:00.823107 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:00.823075 2562 generic.go:356] "Generic (PLEG): container finished" podID="055cdee5-289d-4943-a1cb-9432b7898b5c" containerID="f9ed2dfaf7aa11fc23824fd706f5948c6568c725be251d2a17e56047489f09f5" exitCode=2 Jun 11 16:14:00.823278 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:00.823136 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerDied","Data":"f9ed2dfaf7aa11fc23824fd706f5948c6568c725be251d2a17e56047489f09f5"} Jun 11 16:14:00.823278 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:00.823167 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7b9996f947-txx8w" event={"ID":"055cdee5-289d-4943-a1cb-9432b7898b5c","Type":"ContainerStarted","Data":"7113dc61e1632825e7177272b25081b2b1ae0926881fdbbbcba8abbde39c6a3b"} Jun 11 16:14:00.866688 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:00.866647 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:00.938641 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:00.938607 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:01.546690 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.546657 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:14:01.548954 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.548938 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.556047 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.556021 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 11 16:14:01.561808 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.561783 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:14:01.655019 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.654983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655019 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655022 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655049 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655119 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655137 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.655237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.655222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffhvp\" (UniqueName: \"kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.705993 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.705965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:01.755771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.755732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.755771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.755771 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756010 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.755793 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756010 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.755911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffhvp\" (UniqueName: \"kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756179 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756179 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756044 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756281 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756213 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756654 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756619 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756760 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756947 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.756988 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.756925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.758475 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.758450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.758532 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.758495 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.764451 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.764429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffhvp\" (UniqueName: \"kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp\") pod \"console-7b54b48655-p7qfb\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.772966 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.772945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:01.857936 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.857835 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:01.984537 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:01.984507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:14:01.987555 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:14:01.987512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382eea40_2570_4240_8532_9e360c023823.slice/crio-060cb27961fb63ef17db50a2ba4824670d0a12adabd4831bf4a092ac26b81712 WatchSource:0}: Error finding container 060cb27961fb63ef17db50a2ba4824670d0a12adabd4831bf4a092ac26b81712: Status 404 returned error can't find the container with id 060cb27961fb63ef17db50a2ba4824670d0a12adabd4831bf4a092ac26b81712 Jun 11 16:14:02.114867 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:02.114784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:02.183134 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:02.183103 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:02.830913 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:02.830877 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54b48655-p7qfb" event={"ID":"382eea40-2570-4240-8532-9e360c023823","Type":"ContainerStarted","Data":"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a"} Jun 11 16:14:02.830913 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:02.830920 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54b48655-p7qfb" event={"ID":"382eea40-2570-4240-8532-9e360c023823","Type":"ContainerStarted","Data":"060cb27961fb63ef17db50a2ba4824670d0a12adabd4831bf4a092ac26b81712"} Jun 11 16:14:02.852015 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:02.848216 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7b54b48655-p7qfb" podStartSLOduration=1.8481970030000001 podStartE2EDuration="1.848197003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:14:02.8480131 +0000 UTC m=+309.501984912" watchObservedRunningTime="2026-06-11 16:14:02.848197003 +0000 UTC m=+309.502168794" Jun 11 16:14:03.157190 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:03.157087 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:03.157190 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:03.157185 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:03.162023 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:03.161992 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:03.838086 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:03.838060 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:04.769560 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:04.769528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:14:07.085437 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:07.085381 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:07.200318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:07.200275 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:08.258725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:08.258694 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:14:08.258725 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:08.258703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:08.259270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:08.258750 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:14:08.361034 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:08.360999 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:10.045453 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:10.045416 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:10.138917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:10.138883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:11.859007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:11.858956 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:11.859513 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:11.859027 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:11.863957 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:11.863933 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:12.610762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:12.610733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:12.713728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:12.713692 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:12.869540 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:12.869457 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:14:12.941198 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:12.941166 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:14:13.168031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:13.167926 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:13.277668 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:13.277637 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:27.631767 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:27.631718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:27.738551 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:27.738500 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:28.264371 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:28.264339 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:14:28.268329 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:28.268296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-78b865899-vf4ml" Jun 11 16:14:37.962834 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:37.962746 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b5554b5cf-xwhfk" podUID="d51ce6a1-20db-415b-bb19-fd04110a8ade" containerName="console" containerID="cri-o://b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621" gracePeriod=15 Jun 11 16:14:38.224457 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.224378 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:38.251257 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251173 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251257 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251244 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9kd\" (UniqueName: \"kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251533 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251275 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251533 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251299 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251533 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251316 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251533 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251367 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert\") pod \"d51ce6a1-20db-415b-bb19-fd04110a8ade\" (UID: \"d51ce6a1-20db-415b-bb19-fd04110a8ade\") " Jun 11 16:14:38.251792 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251765 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config" (OuterVolumeSpecName: "console-config") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:14:38.251915 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.251892 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca" (OuterVolumeSpecName: "service-ca") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:14:38.252037 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.252014 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.252091 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.252043 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-service-ca\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.252213 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.252189 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:14:38.253889 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.253851 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:14:38.254033 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.253906 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:14:38.254405 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.254361 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd" (OuterVolumeSpecName: "kube-api-access-pt9kd") pod "d51ce6a1-20db-415b-bb19-fd04110a8ade" (UID: "d51ce6a1-20db-415b-bb19-fd04110a8ade"). InnerVolumeSpecName "kube-api-access-pt9kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:14:38.353403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.353362 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.353403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.353405 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d51ce6a1-20db-415b-bb19-fd04110a8ade-console-oauth-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.353590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.353418 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9kd\" (UniqueName: \"kubernetes.io/projected/d51ce6a1-20db-415b-bb19-fd04110a8ade-kube-api-access-pt9kd\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.353590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.353427 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d51ce6a1-20db-415b-bb19-fd04110a8ade-oauth-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:14:38.962321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.962059 2562 generic.go:356] "Generic (PLEG): container finished" podID="d51ce6a1-20db-415b-bb19-fd04110a8ade" containerID="b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621" exitCode=0 Jun 11 16:14:38.962321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.962115 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5554b5cf-xwhfk" event={"ID":"d51ce6a1-20db-415b-bb19-fd04110a8ade","Type":"ContainerDied","Data":"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621"} Jun 11 16:14:38.962321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.962166 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5554b5cf-xwhfk" event={"ID":"d51ce6a1-20db-415b-bb19-fd04110a8ade","Type":"ContainerDied","Data":"217b0b7a2e666ce3ec41f68c88f7cafa312093c86bf56d4f8ca9d39c95bb7690"} Jun 11 16:14:38.962321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.962195 2562 scope.go:117] "RemoveContainer" containerID="b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621" Jun 11 16:14:38.962321 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.962233 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5554b5cf-xwhfk" Jun 11 16:14:38.972307 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.972283 2562 scope.go:117] "RemoveContainer" containerID="b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621" Jun 11 16:14:38.972663 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:14:38.972638 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621\": container with ID starting with b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621 not found: ID does not exist" containerID="b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621" Jun 11 16:14:38.972749 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.972677 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621"} err="failed to get container status \"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621\": rpc error: code = NotFound desc = could not find container \"b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621\": container with ID starting with b930c0bd61ae1124ab80632ece95e0b7ccd849a3643084cc435c0720b5917621 not found: ID does not exist" Jun 11 16:14:38.991216 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.991184 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:14:38.998096 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:38.998071 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b5554b5cf-xwhfk"] Jun 11 16:14:39.775202 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:39.775167 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d51ce6a1-20db-415b-bb19-fd04110a8ade" path="/var/lib/kubelet/pods/d51ce6a1-20db-415b-bb19-fd04110a8ade/volumes" Jun 11 16:14:59.791188 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:59.791154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:59.880204 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:59.880170 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:14:59.981007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:14:59.980976 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:00.080644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:00.080552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:02.282054 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.282022 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:15:02.282458 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.282269 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d51ce6a1-20db-415b-bb19-fd04110a8ade" containerName="console" Jun 11 16:15:02.282458 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.282281 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d51ce6a1-20db-415b-bb19-fd04110a8ade" containerName="console" Jun 11 16:15:02.282458 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.282342 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d51ce6a1-20db-415b-bb19-fd04110a8ade" containerName="console" Jun 11 16:15:02.286752 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.286731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.307197 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.307167 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:15:02.382121 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.382089 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:02.447921 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.447879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.447921 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.447926 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.448161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.447955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.448161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.447970 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.448161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.448043 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.448161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.448079 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.448161 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.448099 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.483883 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.483841 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:02.549133 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549133 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549092 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549136 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549169 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549194 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549273 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549856 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549831 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.549959 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.549911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.550055 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.550032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.550150 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.550131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.551684 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.551661 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.551774 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.551694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.559095 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.559071 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964\") pod \"console-97bc65679-qspwg\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.588444 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.588412 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:02.595450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.595425 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:02.730286 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:02.730254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:15:02.733656 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:15:02.733630 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a626d7e_f2e1_4db7_af2e_583ee671de16.slice/crio-911e102d67e2b109b308eee524882f740f0e0a81b6b3cec49f76e8bd05bd6b02 WatchSource:0}: Error finding container 911e102d67e2b109b308eee524882f740f0e0a81b6b3cec49f76e8bd05bd6b02: Status 404 returned error can't find the container with id 911e102d67e2b109b308eee524882f740f0e0a81b6b3cec49f76e8bd05bd6b02 Jun 11 16:15:03.045475 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:03.045444 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bc65679-qspwg" event={"ID":"5a626d7e-f2e1-4db7-af2e-583ee671de16","Type":"ContainerStarted","Data":"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5"} Jun 11 16:15:03.045649 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:03.045490 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bc65679-qspwg" event={"ID":"5a626d7e-f2e1-4db7-af2e-583ee671de16","Type":"ContainerStarted","Data":"911e102d67e2b109b308eee524882f740f0e0a81b6b3cec49f76e8bd05bd6b02"} Jun 11 16:15:03.068996 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:03.068941 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97bc65679-qspwg" podStartSLOduration=1.0689213340000001 podStartE2EDuration="1.068921334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:15:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:15:03.0674959 +0000 UTC m=+369.721467687" watchObservedRunningTime="2026-06-11 16:15:03.068921334 +0000 UTC m=+369.722893124" Jun 11 16:15:03.092147 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:03.092117 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:03.214362 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:03.214328 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:07.692337 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.692293 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:15:07.694752 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.694727 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef8579aa-025c-4bc3-b190-6610c84e8feb-metrics-certs\") pod \"network-metrics-daemon-5cszm\" (UID: \"ef8579aa-025c-4bc3-b190-6610c84e8feb\") " pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:15:07.772186 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.772156 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kx8mw\"" Jun 11 16:15:07.780057 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.780033 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5cszm" Jun 11 16:15:07.905715 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.905690 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5cszm"] Jun 11 16:15:07.908260 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:15:07.908234 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef8579aa_025c_4bc3_b190_6610c84e8feb.slice/crio-1b1b12e7e90fb22c6d8ae5621fc105e5fd6e9e18c3255fcc3ca279d383c29ae6 WatchSource:0}: Error finding container 1b1b12e7e90fb22c6d8ae5621fc105e5fd6e9e18c3255fcc3ca279d383c29ae6: Status 404 returned error can't find the container with id 1b1b12e7e90fb22c6d8ae5621fc105e5fd6e9e18c3255fcc3ca279d383c29ae6 Jun 11 16:15:07.910356 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:07.910340 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:15:08.068573 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:08.068536 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cszm" event={"ID":"ef8579aa-025c-4bc3-b190-6610c84e8feb","Type":"ContainerStarted","Data":"1b1b12e7e90fb22c6d8ae5621fc105e5fd6e9e18c3255fcc3ca279d383c29ae6"} Jun 11 16:15:09.073647 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:09.073612 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cszm" event={"ID":"ef8579aa-025c-4bc3-b190-6610c84e8feb","Type":"ContainerStarted","Data":"e5e74824b8a9b505923abcabb4fd0ed354063762b919f1cf335a5592b0f5ffb8"} Jun 11 16:15:09.074000 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:09.073663 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5cszm" event={"ID":"ef8579aa-025c-4bc3-b190-6610c84e8feb","Type":"ContainerStarted","Data":"5c4fe78ab4d6789895f48673d8b4bc87c57fe04056eced3c9b3f61b6ccb8cea7"} Jun 11 16:15:09.096689 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:09.096632 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5cszm" podStartSLOduration=375.1471663 podStartE2EDuration="6m16.09661541s" totalImagesPullingTime="949.44911ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:15:09.096509671 +0000 UTC m=+375.750481480" watchObservedRunningTime="2026-06-11 16:15:09.09661541 +0000 UTC m=+375.750587199" Jun 11 16:15:09.264275 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:09.264241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:09.357230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:09.357197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:11.702728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:11.702692 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:11.803707 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:11.803675 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:12.480576 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:12.480543 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:12.540221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:12.540189 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:12.596409 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:12.596356 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:12.596577 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:12.596448 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:12.601083 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:12.601055 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:13.090455 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:13.090427 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:15:13.142462 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:13.142433 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:15:13.263289 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:13.263260 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:13.362072 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:13.361986 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:13.420342 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:13.420316 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:27.664327 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:27.664289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:27.754404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:27.754345 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:38.161323 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.161282 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7b54b48655-p7qfb" podUID="382eea40-2570-4240-8532-9e360c023823" containerName="console" containerID="cri-o://74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a" gracePeriod=15 Jun 11 16:15:38.399134 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.399111 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:15:38.423195 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423129 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423195 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423179 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423346 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423284 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423426 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423357 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423426 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423410 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423536 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423442 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ffhvp\" (UniqueName: \"kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423536 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423473 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert\") pod \"382eea40-2570-4240-8532-9e360c023823\" (UID: \"382eea40-2570-4240-8532-9e360c023823\") " Jun 11 16:15:38.423637 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423612 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:15:38.423700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423675 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:15:38.423700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423692 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-oauth-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.423799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423677 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config" (OuterVolumeSpecName: "console-config") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:15:38.423799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.423778 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca" (OuterVolumeSpecName: "service-ca") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:15:38.425668 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.425630 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp" (OuterVolumeSpecName: "kube-api-access-ffhvp") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "kube-api-access-ffhvp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:15:38.425993 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.425966 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:15:38.426259 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.426227 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "382eea40-2570-4240-8532-9e360c023823" (UID: "382eea40-2570-4240-8532-9e360c023823"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:15:38.524545 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524508 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-service-ca\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.524545 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524539 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-oauth-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.524545 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524549 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ffhvp\" (UniqueName: \"kubernetes.io/projected/382eea40-2570-4240-8532-9e360c023823-kube-api-access-ffhvp\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.524772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524558 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/382eea40-2570-4240-8532-9e360c023823-console-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.524772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524567 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-console-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:38.524772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:38.524575 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/382eea40-2570-4240-8532-9e360c023823-trusted-ca-bundle\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:15:39.178329 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.178291 2562 generic.go:356] "Generic (PLEG): container finished" podID="382eea40-2570-4240-8532-9e360c023823" containerID="74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a" exitCode=0 Jun 11 16:15:39.178723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.178344 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b54b48655-p7qfb" Jun 11 16:15:39.178723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.178377 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54b48655-p7qfb" event={"ID":"382eea40-2570-4240-8532-9e360c023823","Type":"ContainerDied","Data":"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a"} Jun 11 16:15:39.178723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.178448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b54b48655-p7qfb" event={"ID":"382eea40-2570-4240-8532-9e360c023823","Type":"ContainerDied","Data":"060cb27961fb63ef17db50a2ba4824670d0a12adabd4831bf4a092ac26b81712"} Jun 11 16:15:39.178723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.178470 2562 scope.go:117] "RemoveContainer" containerID="74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a" Jun 11 16:15:39.186810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.186792 2562 scope.go:117] "RemoveContainer" containerID="74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a" Jun 11 16:15:39.187065 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:15:39.187049 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a\": container with ID starting with 74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a not found: ID does not exist" containerID="74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a" Jun 11 16:15:39.187112 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.187073 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a"} err="failed to get container status \"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a\": rpc error: code = NotFound desc = could not find container \"74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a\": container with ID starting with 74d47637b9d58f885b0e2d50ccd3a5c05142ef80458457821cdd5e0ce048819a not found: ID does not exist" Jun 11 16:15:39.200322 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.200300 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:15:39.206350 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.206327 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b54b48655-p7qfb"] Jun 11 16:15:39.773860 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:39.773829 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="382eea40-2570-4240-8532-9e360c023823" path="/var/lib/kubelet/pods/382eea40-2570-4240-8532-9e360c023823/volumes" Jun 11 16:15:56.139934 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:56.139897 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:15:56.204270 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:15:56.204241 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:16:06.796708 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:16:06.796617 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:16:06.887847 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:16:06.887812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:16:39.054025 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:16:39.053990 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:16:39.118125 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:16:39.118096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:51.854488 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:51.854451 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:52.173547 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:52.173465 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:55.658658 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:55.658624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:55.813589 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:55.813552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:57.288245 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:57.288212 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:57.391783 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:57.391753 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:57.881421 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:57.881370 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:17:57.997954 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:17:57.997921 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:00.587255 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:00.587214 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:01.200504 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:01.200471 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:02.656045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:02.656012 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:02.749049 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:02.749002 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:04.965993 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.965960 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp"] Jun 11 16:18:04.966356 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.966208 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="382eea40-2570-4240-8532-9e360c023823" containerName="console" Jun 11 16:18:04.966356 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.966218 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="382eea40-2570-4240-8532-9e360c023823" containerName="console" Jun 11 16:18:04.966356 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.966269 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="382eea40-2570-4240-8532-9e360c023823" containerName="console" Jun 11 16:18:04.968960 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.968944 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:04.971061 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.971041 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 16:18:04.971488 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.971471 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 16:18:04.971541 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.971481 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-fsjcd\"" Jun 11 16:18:04.980318 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:04.980295 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp"] Jun 11 16:18:05.115252 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.115217 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.115451 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.115269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92cm2\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-kube-api-access-92cm2\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.215755 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.215709 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.215920 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.215792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92cm2\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-kube-api-access-92cm2\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.223834 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.223779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.224083 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.224059 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92cm2\" (UniqueName: \"kubernetes.io/projected/d30e6f3d-ec01-428d-a8ce-c2c996cf9213-kube-api-access-92cm2\") pod \"cert-manager-cainjector-5d99449ffd-zfbnp\" (UID: \"d30e6f3d-ec01-428d-a8ce-c2c996cf9213\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.277845 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.277814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" Jun 11 16:18:05.401781 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.401746 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp"] Jun 11 16:18:05.404799 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:18:05.404772 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd30e6f3d_ec01_428d_a8ce_c2c996cf9213.slice/crio-e2f62d69a4d4dba574864cd61f4a9ec506dfe1854292c2e32d024b919efbbd1c WatchSource:0}: Error finding container e2f62d69a4d4dba574864cd61f4a9ec506dfe1854292c2e32d024b919efbbd1c: Status 404 returned error can't find the container with id e2f62d69a4d4dba574864cd61f4a9ec506dfe1854292c2e32d024b919efbbd1c Jun 11 16:18:05.669576 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:05.669543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" event={"ID":"d30e6f3d-ec01-428d-a8ce-c2c996cf9213","Type":"ContainerStarted","Data":"e2f62d69a4d4dba574864cd61f4a9ec506dfe1854292c2e32d024b919efbbd1c"} Jun 11 16:18:08.683891 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:08.683797 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" event={"ID":"d30e6f3d-ec01-428d-a8ce-c2c996cf9213","Type":"ContainerStarted","Data":"50d2e2e2ddb0fba4222a9a5db53bfec8c9a7d2a6baec71aa060d07b79dfe330b"} Jun 11 16:18:08.700984 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:08.700935 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-zfbnp" podStartSLOduration=1.709544951 podStartE2EDuration="4.70092032s" totalImagesPullingTime="2.991375369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:18:08.700135375 +0000 UTC m=+555.354107169" watchObservedRunningTime="2026-06-11 16:18:08.70092032 +0000 UTC m=+555.354892110" Jun 11 16:18:09.081226 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:09.081191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:09.181670 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:09.181632 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:09.246448 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:09.246417 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:09.555937 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:09.555906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:09.656206 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:09.656179 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:12.663917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:12.663881 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:12.759557 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:12.759523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:18.801575 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:18.801540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:18.901693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:18.901658 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:20.791222 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:20.791183 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:34.981731 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:34.981693 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:35.086001 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:35.085965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:35.637447 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:35.637413 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:35.912727 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:35.912630 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.010289 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.010256 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.076260 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.076226 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd"] Jun 11 16:18:36.081174 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.081154 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.084008 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.083979 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 16:18:36.084131 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.084066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-clg2l\"" Jun 11 16:18:36.084334 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.084316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 16:18:36.084667 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.084649 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 16:18:36.088488 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.088469 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 16:18:36.112902 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.112878 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd"] Jun 11 16:18:36.147887 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.147854 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-manifests\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.147887 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.147884 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.148116 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.147907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-tmp\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.148116 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.147975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.148116 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.148003 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nr6b\" (UniqueName: \"kubernetes.io/projected/92acf591-b64d-4a5b-983f-9edc9f3771c5-kube-api-access-9nr6b\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.238187 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.238147 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.249298 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nr6b\" (UniqueName: \"kubernetes.io/projected/92acf591-b64d-4a5b-983f-9edc9f3771c5-kube-api-access-9nr6b\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.249495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249327 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-manifests\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.249495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249353 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.249495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-tmp\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.249495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.249818 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.249794 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-manifests\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.251800 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.251775 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/92acf591-b64d-4a5b-983f-9edc9f3771c5-tmp\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.251892 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.251812 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-webhook-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.251992 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.251975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/92acf591-b64d-4a5b-983f-9edc9f3771c5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.262566 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.262537 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nr6b\" (UniqueName: \"kubernetes.io/projected/92acf591-b64d-4a5b-983f-9edc9f3771c5-kube-api-access-9nr6b\") pod \"opendatahub-operator-controller-manager-fb875574b-6gwkd\" (UID: \"92acf591-b64d-4a5b-983f-9edc9f3771c5\") " pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.334014 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.333982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.391099 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.391066 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:36.439184 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.438721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.549579 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.549544 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.550036 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.550016 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd"] Jun 11 16:18:36.552458 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:18:36.552426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92acf591_b64d_4a5b_983f_9edc9f3771c5.slice/crio-9acb8ae3e874d5326f682bb4c00aa1f90e0fe0881bfac09582eb933e68386466 WatchSource:0}: Error finding container 9acb8ae3e874d5326f682bb4c00aa1f90e0fe0881bfac09582eb933e68386466: Status 404 returned error can't find the container with id 9acb8ae3e874d5326f682bb4c00aa1f90e0fe0881bfac09582eb933e68386466 Jun 11 16:18:36.648810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.648778 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.751730 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.751694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:36.779474 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:36.779434 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" event={"ID":"92acf591-b64d-4a5b-983f-9edc9f3771c5","Type":"ContainerStarted","Data":"9acb8ae3e874d5326f682bb4c00aa1f90e0fe0881bfac09582eb933e68386466"} Jun 11 16:18:37.061587 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:37.061550 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:39.791584 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:39.791544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" event={"ID":"92acf591-b64d-4a5b-983f-9edc9f3771c5","Type":"ContainerStarted","Data":"21f35c09dbee77e49bd5333f8f5d3b615fd746ed698bdda72095a019826216b4"} Jun 11 16:18:40.796733 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:40.796702 2562 generic.go:356] "Generic (PLEG): container finished" podID="92acf591-b64d-4a5b-983f-9edc9f3771c5" containerID="21f35c09dbee77e49bd5333f8f5d3b615fd746ed698bdda72095a019826216b4" exitCode=0 Jun 11 16:18:40.797101 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:40.796756 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" event={"ID":"92acf591-b64d-4a5b-983f-9edc9f3771c5","Type":"ContainerDied","Data":"21f35c09dbee77e49bd5333f8f5d3b615fd746ed698bdda72095a019826216b4"} Jun 11 16:18:41.128250 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:41.128208 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:41.212323 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:41.212287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:41.802320 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:41.802284 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" event={"ID":"92acf591-b64d-4a5b-983f-9edc9f3771c5","Type":"ContainerStarted","Data":"ab45cf44c78aeac3df02175c607e4894bda46e907728a9a76d9acfb3e2698bf2"} Jun 11 16:18:41.802802 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:41.802398 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:41.824184 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:41.824122 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" podStartSLOduration=1.496430086 podStartE2EDuration="5.824103711s" totalImagesPullingTime="3.402442402s" totalInitContainerRuntime="925.231223ms" isStatefulPod=false podCreationTimestamp="2026-06-11 16:18:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:18:41.822559034 +0000 UTC m=+588.476530862" watchObservedRunningTime="2026-06-11 16:18:41.824103711 +0000 UTC m=+588.478075503" Jun 11 16:18:47.807473 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:47.807415 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:48.882772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:48.882736 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:52.807829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:52.807801 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-fb875574b-6gwkd" Jun 11 16:18:53.516597 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.516563 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8"] Jun 11 16:18:53.524183 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.524160 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.526604 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.526583 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:18:53.527198 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.527176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:18:53.527309 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.527203 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:18:53.527309 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.527213 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:18:53.527309 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.527213 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:18:53.527452 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.527176 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8nvk8\"" Jun 11 16:18:53.532274 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.532254 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8"] Jun 11 16:18:53.588609 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.588580 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b54c091-0698-4312-9280-dcefee235946-manager-config\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.588766 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.588624 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-metrics-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.588766 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.588665 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.588766 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.588683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h45mc\" (UniqueName: \"kubernetes.io/projected/9b54c091-0698-4312-9280-dcefee235946-kube-api-access-h45mc\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.689578 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.689548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.689578 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.689581 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h45mc\" (UniqueName: \"kubernetes.io/projected/9b54c091-0698-4312-9280-dcefee235946-kube-api-access-h45mc\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.689824 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.689615 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b54c091-0698-4312-9280-dcefee235946-manager-config\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.689824 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.689640 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-metrics-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.691517 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.691493 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 16:18:53.691633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.691493 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 16:18:53.691633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.691495 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 16:18:53.696381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.696366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 16:18:53.701234 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.701209 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9b54c091-0698-4312-9280-dcefee235946-manager-config\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.703195 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.703167 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.703195 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.703181 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9b54c091-0698-4312-9280-dcefee235946-metrics-cert\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.707452 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.707434 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 16:18:53.717855 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.717833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h45mc\" (UniqueName: \"kubernetes.io/projected/9b54c091-0698-4312-9280-dcefee235946-kube-api-access-h45mc\") pod \"lws-controller-manager-67c4b4c7b5-kcnb8\" (UID: \"9b54c091-0698-4312-9280-dcefee235946\") " pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.741531 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.741514 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:18:53.741840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.741823 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:18:53.835896 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.835767 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8nvk8\"" Jun 11 16:18:53.844047 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.844024 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:53.978326 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:53.978289 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8"] Jun 11 16:18:53.981647 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:18:53.981618 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b54c091_0698_4312_9280_dcefee235946.slice/crio-4aa39c0c1630e95ee6667c5c2e0008a51f622f774cd991d2b5f7ed468373851d WatchSource:0}: Error finding container 4aa39c0c1630e95ee6667c5c2e0008a51f622f774cd991d2b5f7ed468373851d: Status 404 returned error can't find the container with id 4aa39c0c1630e95ee6667c5c2e0008a51f622f774cd991d2b5f7ed468373851d Jun 11 16:18:54.850754 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:54.850721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" event={"ID":"9b54c091-0698-4312-9280-dcefee235946","Type":"ContainerStarted","Data":"4aa39c0c1630e95ee6667c5c2e0008a51f622f774cd991d2b5f7ed468373851d"} Jun 11 16:18:55.113770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:55.113605 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:55.231900 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:55.231857 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:55.704104 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:55.704060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:55.853310 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:55.853272 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:56.009184 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:56.009148 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:56.116593 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:56.116547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:56.346506 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:56.346407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:56.427822 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:56.427789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:56.521113 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:56.521073 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:57.094769 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:57.094733 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:57.507251 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:57.507218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:18:57.865776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:57.865680 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" event={"ID":"9b54c091-0698-4312-9280-dcefee235946","Type":"ContainerStarted","Data":"3f122e34b2dd7f7f870c56089057a0d70c3d232c7cf2aa1eddd8be546e860193"} Jun 11 16:18:57.865943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:57.865825 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:18:57.883511 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:18:57.883439 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" podStartSLOduration=1.87286189 podStartE2EDuration="4.883421161s" totalImagesPullingTime="3.010559271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:18:57.882275936 +0000 UTC m=+604.536247737" watchObservedRunningTime="2026-06-11 16:18:57.883421161 +0000 UTC m=+604.537392952" Jun 11 16:19:04.850825 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.850788 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5977456657-cwwcm"] Jun 11 16:19:04.854488 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.854465 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.891283 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.891247 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5977456657-cwwcm"] Jun 11 16:19:04.996199 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996162 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-service-ca\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996436 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996230 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-console-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996436 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996301 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvjgz\" (UniqueName: \"kubernetes.io/projected/973a6cd5-9771-476b-ab46-a22d298efd8d-kube-api-access-pvjgz\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996436 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-trusted-ca-bundle\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996435 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-oauth-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:04.996572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:04.996494 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-oauth-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.017071 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.017014 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:05.097718 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-console-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvjgz\" (UniqueName: \"kubernetes.io/projected/973a6cd5-9771-476b-ab46-a22d298efd8d-kube-api-access-pvjgz\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-trusted-ca-bundle\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097795 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-oauth-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097811 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-oauth-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.097919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.097846 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-service-ca\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.098622 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.098578 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-console-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.098622 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.098604 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-oauth-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.098814 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.098667 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-service-ca\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.098814 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.098729 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/973a6cd5-9771-476b-ab46-a22d298efd8d-trusted-ca-bundle\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.100257 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.100227 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-oauth-config\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.100419 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.100379 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/973a6cd5-9771-476b-ab46-a22d298efd8d-console-serving-cert\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.105962 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.105911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvjgz\" (UniqueName: \"kubernetes.io/projected/973a6cd5-9771-476b-ab46-a22d298efd8d-kube-api-access-pvjgz\") pod \"console-5977456657-cwwcm\" (UID: \"973a6cd5-9771-476b-ab46-a22d298efd8d\") " pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.117583 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.117555 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:05.162583 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.162551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:05.217872 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.217830 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:05.301620 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.301572 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5977456657-cwwcm"] Jun 11 16:19:05.307028 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:19:05.307000 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973a6cd5_9771_476b_ab46_a22d298efd8d.slice/crio-3758cb2a68ecef5f73fd4b838fc4c0362d465baa97903b801c03386e6eecf548 WatchSource:0}: Error finding container 3758cb2a68ecef5f73fd4b838fc4c0362d465baa97903b801c03386e6eecf548: Status 404 returned error can't find the container with id 3758cb2a68ecef5f73fd4b838fc4c0362d465baa97903b801c03386e6eecf548 Jun 11 16:19:05.587865 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.587825 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:05.702487 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.702379 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:05.899057 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.899016 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5977456657-cwwcm" event={"ID":"973a6cd5-9771-476b-ab46-a22d298efd8d","Type":"ContainerStarted","Data":"1b9013fce31c21eb5407db3bd15e5c32a31a0d52f633f2e33f34fc4464fc0a38"} Jun 11 16:19:05.899475 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.899099 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5977456657-cwwcm" event={"ID":"973a6cd5-9771-476b-ab46-a22d298efd8d","Type":"ContainerStarted","Data":"3758cb2a68ecef5f73fd4b838fc4c0362d465baa97903b801c03386e6eecf548"} Jun 11 16:19:05.953668 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:05.953448 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5977456657-cwwcm" podStartSLOduration=1.953428782 podStartE2EDuration="1.953428782s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:05.952459614 +0000 UTC m=+612.606431404" watchObservedRunningTime="2026-06-11 16:19:05.953428782 +0000 UTC m=+612.607400573" Jun 11 16:19:06.170004 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:06.169969 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:06.283453 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:06.283420 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:06.502610 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:06.502577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:06.777678 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:06.777639 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:07.528587 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:07.528545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:07.669201 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:07.669166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:08.871269 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:08.871239 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67c4b4c7b5-kcnb8" Jun 11 16:19:10.989611 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:10.989568 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:11.052685 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:11.052644 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:14.441763 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:14.441728 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:14.585151 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:14.585120 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:15.163254 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:15.163217 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:15.163461 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:15.163305 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:15.168375 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:15.168352 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:15.941608 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:15.941583 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5977456657-cwwcm" Jun 11 16:19:16.050553 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:16.050518 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:19:16.305707 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:16.305663 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:16.430452 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:16.430418 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:16.583203 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:16.583119 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:16.814236 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:16.814201 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:17.185403 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:17.185339 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:17.365840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:17.365809 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:26.276715 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.276680 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-758d6cf95f-pnzxq"] Jun 11 16:19:26.286479 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.286453 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.288835 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.288811 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-pdf85\"" Jun 11 16:19:26.288958 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.288858 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 16:19:26.293803 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.293780 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-758d6cf95f-pnzxq"] Jun 11 16:19:26.313633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.313591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:26.361790 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.361736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qfp\" (UniqueName: \"kubernetes.io/projected/6a50b8fb-104b-4130-957f-b7cb3d174427-kube-api-access-54qfp\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.361954 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.361807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a50b8fb-104b-4130-957f-b7cb3d174427-redirect-config\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.462553 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.462506 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a50b8fb-104b-4130-957f-b7cb3d174427-redirect-config\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.462753 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.462609 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qfp\" (UniqueName: \"kubernetes.io/projected/6a50b8fb-104b-4130-957f-b7cb3d174427-kube-api-access-54qfp\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.463269 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.463247 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/6a50b8fb-104b-4130-957f-b7cb3d174427-redirect-config\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.473445 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.473421 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qfp\" (UniqueName: \"kubernetes.io/projected/6a50b8fb-104b-4130-957f-b7cb3d174427-kube-api-access-54qfp\") pod \"dashboard-redirect-758d6cf95f-pnzxq\" (UID: \"6a50b8fb-104b-4130-957f-b7cb3d174427\") " pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.598232 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.598143 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" Jun 11 16:19:26.733651 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.733557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-758d6cf95f-pnzxq"] Jun 11 16:19:26.736780 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:19:26.736742 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a50b8fb_104b_4130_957f_b7cb3d174427.slice/crio-f5e65cf9339a0307321b28502fd95eca11940f2fe35545143b5a7a3177639efa WatchSource:0}: Error finding container f5e65cf9339a0307321b28502fd95eca11940f2fe35545143b5a7a3177639efa: Status 404 returned error can't find the container with id f5e65cf9339a0307321b28502fd95eca11940f2fe35545143b5a7a3177639efa Jun 11 16:19:26.983703 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:26.983666 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" event={"ID":"6a50b8fb-104b-4130-957f-b7cb3d174427","Type":"ContainerStarted","Data":"f5e65cf9339a0307321b28502fd95eca11940f2fe35545143b5a7a3177639efa"} Jun 11 16:19:27.492590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:27.492562 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:27.594882 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:27.594842 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:32.009562 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:32.009523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" event={"ID":"6a50b8fb-104b-4130-957f-b7cb3d174427","Type":"ContainerStarted","Data":"7f683c0bf06e5e131be39a1c828055de1fe4b14aa7be0ecb5fc06a977805585f"} Jun 11 16:19:32.027813 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:32.027768 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-758d6cf95f-pnzxq" podStartSLOduration=1.4343232910000001 podStartE2EDuration="6.027753931s" totalImagesPullingTime="4.59343064s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:32.026859004 +0000 UTC m=+638.680830793" watchObservedRunningTime="2026-06-11 16:19:32.027753931 +0000 UTC m=+638.681725720" Jun 11 16:19:41.069917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.069876 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-97bc65679-qspwg" podUID="5a626d7e-f2e1-4db7-af2e-583ee671de16" containerName="console" containerID="cri-o://9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5" gracePeriod=15 Jun 11 16:19:41.316076 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.316050 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:19:41.397862 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397769 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.397862 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397821 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.397862 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397838 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.397862 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397854 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.398144 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397870 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.398144 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397926 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.398144 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.397967 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle\") pod \"5a626d7e-f2e1-4db7-af2e-583ee671de16\" (UID: \"5a626d7e-f2e1-4db7-af2e-583ee671de16\") " Jun 11 16:19:41.398289 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.398212 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:19:41.398348 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.398304 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca" (OuterVolumeSpecName: "service-ca") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:19:41.398514 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.398490 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config" (OuterVolumeSpecName: "console-config") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:19:41.398603 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.398521 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 16:19:41.400046 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.400019 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:19:41.400185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.400169 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:19:41.400185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.400174 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964" (OuterVolumeSpecName: "kube-api-access-z5964") pod "5a626d7e-f2e1-4db7-af2e-583ee671de16" (UID: "5a626d7e-f2e1-4db7-af2e-583ee671de16"). InnerVolumeSpecName "kube-api-access-z5964". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:19:41.499244 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499212 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499244 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499239 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-trusted-ca-bundle\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499244 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499249 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-oauth-config\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499259 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-oauth-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499269 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5a626d7e-f2e1-4db7-af2e-583ee671de16-service-ca\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499277 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5a626d7e-f2e1-4db7-af2e-583ee671de16-console-serving-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:41.499494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:41.499285 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5964\" (UniqueName: \"kubernetes.io/projected/5a626d7e-f2e1-4db7-af2e-583ee671de16-kube-api-access-z5964\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:19:42.055709 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.055613 2562 generic.go:356] "Generic (PLEG): container finished" podID="5a626d7e-f2e1-4db7-af2e-583ee671de16" containerID="9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5" exitCode=0 Jun 11 16:19:42.055709 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.055667 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bc65679-qspwg" event={"ID":"5a626d7e-f2e1-4db7-af2e-583ee671de16","Type":"ContainerDied","Data":"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5"} Jun 11 16:19:42.055709 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.055691 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97bc65679-qspwg" Jun 11 16:19:42.055931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.055747 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97bc65679-qspwg" event={"ID":"5a626d7e-f2e1-4db7-af2e-583ee671de16","Type":"ContainerDied","Data":"911e102d67e2b109b308eee524882f740f0e0a81b6b3cec49f76e8bd05bd6b02"} Jun 11 16:19:42.055931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.055776 2562 scope.go:117] "RemoveContainer" containerID="9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5" Jun 11 16:19:42.063577 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.063561 2562 scope.go:117] "RemoveContainer" containerID="9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5" Jun 11 16:19:42.063839 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:19:42.063820 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5\": container with ID starting with 9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5 not found: ID does not exist" containerID="9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5" Jun 11 16:19:42.063901 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.063850 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5"} err="failed to get container status \"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5\": rpc error: code = NotFound desc = could not find container \"9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5\": container with ID starting with 9ad116e6c7f6758b27a7a48387c206ea3d7369c9e72464768844953cd61087c5 not found: ID does not exist" Jun 11 16:19:42.071349 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.071325 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:19:42.076900 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:42.076880 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97bc65679-qspwg"] Jun 11 16:19:43.774965 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:43.774919 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a626d7e-f2e1-4db7-af2e-583ee671de16" path="/var/lib/kubelet/pods/5a626d7e-f2e1-4db7-af2e-583ee671de16/volumes" Jun 11 16:19:47.863537 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:47.863507 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:47.957627 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:47.957586 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:48.431342 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:48.431295 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.323623 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.323578 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.393617 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.393588 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.590494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.590418 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk"] Jun 11 16:19:51.590694 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.590682 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a626d7e-f2e1-4db7-af2e-583ee671de16" containerName="console" Jun 11 16:19:51.590738 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.590695 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a626d7e-f2e1-4db7-af2e-583ee671de16" containerName="console" Jun 11 16:19:51.590778 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.590747 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a626d7e-f2e1-4db7-af2e-583ee671de16" containerName="console" Jun 11 16:19:51.594842 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.594826 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.596882 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.596858 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 16:19:51.596882 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.596858 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 16:19:51.597036 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.596936 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 16:19:51.597036 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.596947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-bdlmh\"" Jun 11 16:19:51.607794 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.607772 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk"] Jun 11 16:19:51.629340 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.629309 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.680567 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680596 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680714 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ssp\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-kube-api-access-42ssp\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680744 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680762 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680762 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.680998 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.680813 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782110 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782066 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782110 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ssp\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-kube-api-access-42ssp\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782129 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782313 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782381 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782657 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782412 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782657 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782443 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782657 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782486 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782657 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782846 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782730 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.782846 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782833 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.783007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.782984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.784481 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.784463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.784814 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.784797 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.791091 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.791034 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.791223 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.791189 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ssp\" (UniqueName: \"kubernetes.io/projected/c9a66154-0e29-4baa-9d10-25ef6b6c05c8-kube-api-access-42ssp\") pod \"data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk\" (UID: \"c9a66154-0e29-4baa-9d10-25ef6b6c05c8\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:51.847019 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.846922 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:51.905380 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:51.905348 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:52.046374 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:52.046340 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk"] Jun 11 16:19:52.050120 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:19:52.050089 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a66154_0e29_4baa_9d10_25ef6b6c05c8.slice/crio-209940da6f4421f8d546b3f1ffebde126c9b28e0465f545afb4446bc3bbb190b WatchSource:0}: Error finding container 209940da6f4421f8d546b3f1ffebde126c9b28e0465f545afb4446bc3bbb190b: Status 404 returned error can't find the container with id 209940da6f4421f8d546b3f1ffebde126c9b28e0465f545afb4446bc3bbb190b Jun 11 16:19:52.075826 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:52.075795 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:52.096844 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:52.096810 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" event={"ID":"c9a66154-0e29-4baa-9d10-25ef6b6c05c8","Type":"ContainerStarted","Data":"209940da6f4421f8d546b3f1ffebde126c9b28e0465f545afb4446bc3bbb190b"} Jun 11 16:19:52.456821 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:52.456784 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:55.216864 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:55.216823 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:19:55.217137 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:55.216909 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:19:55.217137 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:55.216937 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:19:56.118275 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.118233 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" event={"ID":"c9a66154-0e29-4baa-9d10-25ef6b6c05c8","Type":"ContainerStarted","Data":"b5c3c9469b4c728ccd231f4fdda6b45236c1893fc63d69cea03e5d7a0a3fe5b7"} Jun 11 16:19:56.138305 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.138258 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" podStartSLOduration=1.973924336 podStartE2EDuration="5.138242281s" totalImagesPullingTime="3.164317945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:19:56.137407269 +0000 UTC m=+662.791379075" watchObservedRunningTime="2026-06-11 16:19:56.138242281 +0000 UTC m=+662.792214072" Jun 11 16:19:56.666177 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.666098 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:56.774757 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.774721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:56.794913 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.794872 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:19:56.798184 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.798159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:19:56.800082 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.800053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 16:19:56.800194 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.800110 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 16:19:56.800265 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.800198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2jvzc\"" Jun 11 16:19:56.806763 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.806696 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:19:56.838578 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.838545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:56.906324 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.906287 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:56.915561 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.915533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:56.927920 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:56.927842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hnqq\" (UniqueName: \"kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq\") pod \"kuadrant-operator-catalog-cc6t4\" (UID: \"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342\") " pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:19:57.028633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.028594 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hnqq\" (UniqueName: \"kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq\") pod \"kuadrant-operator-catalog-cc6t4\" (UID: \"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342\") " pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:19:57.037551 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.037517 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hnqq\" (UniqueName: \"kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq\") pod \"kuadrant-operator-catalog-cc6t4\" (UID: \"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342\") " pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:19:57.109786 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.109742 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:19:57.123325 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.123208 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:57.124251 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.124231 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk" Jun 11 16:19:57.169059 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.165116 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:19:57.248322 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.248293 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:19:57.251737 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:19:57.251698 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a38fd6b_510c_4b4c_b9d5_3e7275ac0342.slice/crio-480069d92636919f832c533771ca2e563b2e9a377961e3ef546e94f391235bb1 WatchSource:0}: Error finding container 480069d92636919f832c533771ca2e563b2e9a377961e3ef546e94f391235bb1: Status 404 returned error can't find the container with id 480069d92636919f832c533771ca2e563b2e9a377961e3ef546e94f391235bb1 Jun 11 16:19:57.369882 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.369849 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jhzq"] Jun 11 16:19:57.374311 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.374294 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:19:57.379947 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.379920 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jhzq"] Jun 11 16:19:57.534460 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.534433 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-885wx\" (UniqueName: \"kubernetes.io/projected/d3703acc-7d5f-4279-823b-55666e7e0479-kube-api-access-885wx\") pod \"kuadrant-operator-catalog-4jhzq\" (UID: \"d3703acc-7d5f-4279-823b-55666e7e0479\") " pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:19:57.596441 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.596407 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:57.635330 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.635299 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-885wx\" (UniqueName: \"kubernetes.io/projected/d3703acc-7d5f-4279-823b-55666e7e0479-kube-api-access-885wx\") pod \"kuadrant-operator-catalog-4jhzq\" (UID: \"d3703acc-7d5f-4279-823b-55666e7e0479\") " pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:19:57.645317 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.645284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-885wx\" (UniqueName: \"kubernetes.io/projected/d3703acc-7d5f-4279-823b-55666e7e0479-kube-api-access-885wx\") pod \"kuadrant-operator-catalog-4jhzq\" (UID: \"d3703acc-7d5f-4279-823b-55666e7e0479\") " pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:19:57.684360 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.684329 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:19:57.806891 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.806802 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:19:57.815848 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:57.815818 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4jhzq"] Jun 11 16:19:57.820539 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:19:57.820512 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3703acc_7d5f_4279_823b_55666e7e0479.slice/crio-4a08cf7a715884e66a78e5c985e5883cb3e6cf899d3718998341029f0448ae88 WatchSource:0}: Error finding container 4a08cf7a715884e66a78e5c985e5883cb3e6cf899d3718998341029f0448ae88: Status 404 returned error can't find the container with id 4a08cf7a715884e66a78e5c985e5883cb3e6cf899d3718998341029f0448ae88 Jun 11 16:19:58.129720 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:58.129640 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" event={"ID":"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342","Type":"ContainerStarted","Data":"480069d92636919f832c533771ca2e563b2e9a377961e3ef546e94f391235bb1"} Jun 11 16:19:58.130768 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:19:58.130743 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" event={"ID":"d3703acc-7d5f-4279-823b-55666e7e0479","Type":"ContainerStarted","Data":"4a08cf7a715884e66a78e5c985e5883cb3e6cf899d3718998341029f0448ae88"} Jun 11 16:20:00.141922 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.141833 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" event={"ID":"d3703acc-7d5f-4279-823b-55666e7e0479","Type":"ContainerStarted","Data":"40b91e92514b0edb53b9e87a3340dec0426ccc6c619d0016da678dec253aee6c"} Jun 11 16:20:00.143243 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.143218 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" event={"ID":"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342","Type":"ContainerStarted","Data":"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6"} Jun 11 16:20:00.143361 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.143297 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" podUID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" containerName="registry-server" containerID="cri-o://2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6" gracePeriod=2 Jun 11 16:20:00.157799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.157732 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" podStartSLOduration=1.2032586219999999 podStartE2EDuration="3.157716572s" totalImagesPullingTime="1.95445795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:00.155891896 +0000 UTC m=+666.809863686" watchObservedRunningTime="2026-06-11 16:20:00.157716572 +0000 UTC m=+666.811688362" Jun 11 16:20:00.171864 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.171825 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" podStartSLOduration=1.645329692 podStartE2EDuration="4.171810371s" totalImagesPullingTime="2.526480679s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:19:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:00.1702466 +0000 UTC m=+666.824218417" watchObservedRunningTime="2026-06-11 16:20:00.171810371 +0000 UTC m=+666.825782161" Jun 11 16:20:00.390675 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.390650 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:20:00.558502 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.558472 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hnqq\" (UniqueName: \"kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq\") pod \"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342\" (UID: \"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342\") " Jun 11 16:20:00.560601 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.560570 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq" (OuterVolumeSpecName: "kube-api-access-6hnqq") pod "9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" (UID: "9a38fd6b-510c-4b4c-b9d5-3e7275ac0342"). InnerVolumeSpecName "kube-api-access-6hnqq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:20:00.659494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:00.659464 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hnqq\" (UniqueName: \"kubernetes.io/projected/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342-kube-api-access-6hnqq\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:20:01.149107 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.149074 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" containerID="2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6" exitCode=0 Jun 11 16:20:01.149503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.149132 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" Jun 11 16:20:01.149503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.149158 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" event={"ID":"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342","Type":"ContainerDied","Data":"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6"} Jun 11 16:20:01.149503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.149211 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-cc6t4" event={"ID":"9a38fd6b-510c-4b4c-b9d5-3e7275ac0342","Type":"ContainerDied","Data":"480069d92636919f832c533771ca2e563b2e9a377961e3ef546e94f391235bb1"} Jun 11 16:20:01.149503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.149231 2562 scope.go:117] "RemoveContainer" containerID="2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6" Jun 11 16:20:01.157965 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.157948 2562 scope.go:117] "RemoveContainer" containerID="2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6" Jun 11 16:20:01.158201 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:20:01.158181 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6\": container with ID starting with 2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6 not found: ID does not exist" containerID="2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6" Jun 11 16:20:01.158255 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.158213 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6"} err="failed to get container status \"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6\": rpc error: code = NotFound desc = could not find container \"2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6\": container with ID starting with 2dff3f8f8e5d7a918855da8fa76772e7cf97cb1c67808a89bd83e97232d4aec6 not found: ID does not exist" Jun 11 16:20:01.169301 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.169272 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:20:01.174665 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.174642 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-cc6t4"] Jun 11 16:20:01.774884 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:01.774851 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" path="/var/lib/kubelet/pods/9a38fd6b-510c-4b4c-b9d5-3e7275ac0342/volumes" Jun 11 16:20:07.685343 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:07.685296 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:20:07.685775 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:07.685402 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:20:07.707032 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:07.707004 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:20:08.198631 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:08.198605 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4jhzq" Jun 11 16:20:16.087029 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:16.086957 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:18.133117 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:18.133083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:18.193079 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:18.193048 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:25.993510 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:25.993470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:26.753524 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:26.753486 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:27.168832 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:27.168748 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:29.908096 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.908057 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh"] Jun 11 16:20:29.908663 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.908359 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" containerName="registry-server" Jun 11 16:20:29.908663 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.908372 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" containerName="registry-server" Jun 11 16:20:29.908663 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.908454 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a38fd6b-510c-4b4c-b9d5-3e7275ac0342" containerName="registry-server" Jun 11 16:20:29.919840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.919819 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:29.922581 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.922566 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4zr4h\"" Jun 11 16:20:29.931494 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.931461 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh"] Jun 11 16:20:29.979221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:29.979185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tg7v\" (UniqueName: \"kubernetes.io/projected/2bdf36ae-3f9c-43a0-81fc-4e305ef3f278-kube-api-access-7tg7v\") pod \"authorino-operator-75cc8d5cb7-jsmsh\" (UID: \"2bdf36ae-3f9c-43a0-81fc-4e305ef3f278\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:30.080633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.080596 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tg7v\" (UniqueName: \"kubernetes.io/projected/2bdf36ae-3f9c-43a0-81fc-4e305ef3f278-kube-api-access-7tg7v\") pod \"authorino-operator-75cc8d5cb7-jsmsh\" (UID: \"2bdf36ae-3f9c-43a0-81fc-4e305ef3f278\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:30.090416 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.090371 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tg7v\" (UniqueName: \"kubernetes.io/projected/2bdf36ae-3f9c-43a0-81fc-4e305ef3f278-kube-api-access-7tg7v\") pod \"authorino-operator-75cc8d5cb7-jsmsh\" (UID: \"2bdf36ae-3f9c-43a0-81fc-4e305ef3f278\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:30.229764 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.229681 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:30.371049 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.371012 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh"] Jun 11 16:20:30.373563 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:20:30.373529 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bdf36ae_3f9c_43a0_81fc_4e305ef3f278.slice/crio-77a0a1e74338ea3564cc81a023396f2afcbf4e8b3dbed0c108c95c9390c30ad5 WatchSource:0}: Error finding container 77a0a1e74338ea3564cc81a023396f2afcbf4e8b3dbed0c108c95c9390c30ad5: Status 404 returned error can't find the container with id 77a0a1e74338ea3564cc81a023396f2afcbf4e8b3dbed0c108c95c9390c30ad5 Jun 11 16:20:30.376023 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.376002 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:20:30.542495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:30.542466 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:31.275433 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:31.275398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" event={"ID":"2bdf36ae-3f9c-43a0-81fc-4e305ef3f278","Type":"ContainerStarted","Data":"77a0a1e74338ea3564cc81a023396f2afcbf4e8b3dbed0c108c95c9390c30ad5"} Jun 11 16:20:33.285800 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:33.285703 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" event={"ID":"2bdf36ae-3f9c-43a0-81fc-4e305ef3f278","Type":"ContainerStarted","Data":"b0bb433884f565ef400a5042f96c860c4b3679477560b00527cec2af217d2b26"} Jun 11 16:20:33.286191 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:33.285894 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:33.306360 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:33.306283 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" podStartSLOduration=1.6599132399999998 podStartE2EDuration="4.306254517s" totalImagesPullingTime="2.646341277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:33.302801119 +0000 UTC m=+699.956772918" watchObservedRunningTime="2026-06-11 16:20:33.306254517 +0000 UTC m=+699.960226308" Jun 11 16:20:33.859378 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:33.859341 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:34.146269 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.146181 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x"] Jun 11 16:20:34.151862 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.151841 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.154414 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.154375 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-64sxt\"" Jun 11 16:20:34.172181 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.172151 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x"] Jun 11 16:20:34.218735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.218701 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4j4d\" (UniqueName: \"kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.218880 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.218750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.319973 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.319931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4j4d\" (UniqueName: \"kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.319973 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.319980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.320504 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.320301 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.334848 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.334827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4j4d\" (UniqueName: \"kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d\") pod \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.462346 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.462253 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:34.602921 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.602896 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x"] Jun 11 16:20:34.605203 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:20:34.605178 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ad7632a_c4ee_481a_9a3a_65b0e83d56bf.slice/crio-058f85953a69fd9363e1101b4d15947bd5e87eea19ee746c19758d7ada29f075 WatchSource:0}: Error finding container 058f85953a69fd9363e1101b4d15947bd5e87eea19ee746c19758d7ada29f075: Status 404 returned error can't find the container with id 058f85953a69fd9363e1101b4d15947bd5e87eea19ee746c19758d7ada29f075 Jun 11 16:20:34.752529 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:34.752497 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:35.297700 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:35.297658 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" event={"ID":"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf","Type":"ContainerStarted","Data":"058f85953a69fd9363e1101b4d15947bd5e87eea19ee746c19758d7ada29f075"} Jun 11 16:20:36.630475 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:36.630367 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:36.751811 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:36.751775 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:39.083662 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:39.083624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:40.542609 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:40.542569 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:40.651076 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:40.651042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:40.985886 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:40.985848 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:41.160507 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:41.160473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:42.328852 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:42.328812 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" event={"ID":"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf","Type":"ContainerStarted","Data":"52a06e6da8e8eb8dcb61ea00eab9b3be300748312f921470d7f8015efc5561f7"} Jun 11 16:20:42.329231 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:42.328938 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:42.351432 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:42.351352 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" podStartSLOduration=1.069727753 podStartE2EDuration="8.351339114s" totalImagesPullingTime="7.281611361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:42.350972653 +0000 UTC m=+709.004944464" watchObservedRunningTime="2026-06-11 16:20:42.351339114 +0000 UTC m=+709.005310903" Jun 11 16:20:44.292335 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:44.292303 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-jsmsh" Jun 11 16:20:44.334865 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:44.334832 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:44.434132 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:44.434101 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:44.554917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:44.554834 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:44.906582 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:44.906489 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:51.429889 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:51.429853 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:51.589517 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:51.589473 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:53.336265 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:53.336234 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.267775 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.267739 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x"] Jun 11 16:20:55.268245 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.267981 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" containerName="manager" containerID="cri-o://52a06e6da8e8eb8dcb61ea00eab9b3be300748312f921470d7f8015efc5561f7" gracePeriod=2 Jun 11 16:20:55.289187 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.289156 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x"] Jun 11 16:20:55.295323 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:20:55.295288 2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-rv87x\": pods \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.316943 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.316912 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:20:55.317461 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.317436 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" containerName="manager" Jun 11 16:20:55.317461 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.317462 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" containerName="manager" Jun 11 16:20:55.317608 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.317578 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" containerName="manager" Jun 11 16:20:55.320702 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.320684 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.348181 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.348154 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:20:55.375318 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:20:55.375283 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" is forbidden: User \"system:node:ip-10-0-138-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-8.ec2.internal' and this object" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.384595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.384569 2562 generic.go:356] "Generic (PLEG): container finished" podID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" containerID="52a06e6da8e8eb8dcb61ea00eab9b3be300748312f921470d7f8015efc5561f7" exitCode=0 Jun 11 16:20:55.399025 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.398987 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.399025 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.399017 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxbwm\" (UniqueName: \"kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.471074 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.471049 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t"] Jun 11 16:20:55.474210 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.474193 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.494599 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.494575 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t"] Jun 11 16:20:55.500153 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.500128 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.500259 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.500156 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxbwm\" (UniqueName: \"kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.500572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.500548 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.510631 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.510608 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.520591 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.520542 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxbwm\" (UniqueName: \"kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm\") pod \"kuadrant-operator-controller-manager-8684c9ff49-h926d\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.525875 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:20:55.525848 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" is forbidden: User \"system:node:ip-10-0-138-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-8.ec2.internal' and this object" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.527683 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:20:55.527657 2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-rv87x\" is forbidden: User \"system:node:ip-10-0-138-8.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-8.ec2.internal' and this object" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:55.601129 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.601100 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4j4d\" (UniqueName: \"kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d\") pod \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " Jun 11 16:20:55.601285 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.601146 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume\") pod \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\" (UID: \"1ad7632a-c4ee-481a-9a3a-65b0e83d56bf\") " Jun 11 16:20:55.601350 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.601297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/371b2888-b90c-41b3-a801-ee1e91ed5ece-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.601503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.601479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7s5\" (UniqueName: \"kubernetes.io/projected/371b2888-b90c-41b3-a801-ee1e91ed5ece-kube-api-access-dt7s5\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.601576 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.601557 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" (UID: "1ad7632a-c4ee-481a-9a3a-65b0e83d56bf"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:20:55.603252 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.603229 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d" (OuterVolumeSpecName: "kube-api-access-n4j4d") pod "1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" (UID: "1ad7632a-c4ee-481a-9a3a-65b0e83d56bf"). InnerVolumeSpecName "kube-api-access-n4j4d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:20:55.648165 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.648142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:55.704542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.703645 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7s5\" (UniqueName: \"kubernetes.io/projected/371b2888-b90c-41b3-a801-ee1e91ed5ece-kube-api-access-dt7s5\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.704542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.703725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/371b2888-b90c-41b3-a801-ee1e91ed5ece-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.704542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.703809 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-extensions-socket-volume\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:20:55.704542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.703824 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4j4d\" (UniqueName: \"kubernetes.io/projected/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf-kube-api-access-n4j4d\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:20:55.704542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.704173 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/371b2888-b90c-41b3-a801-ee1e91ed5ece-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.727302 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.727273 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7s5\" (UniqueName: \"kubernetes.io/projected/371b2888-b90c-41b3-a801-ee1e91ed5ece-kube-api-access-dt7s5\") pod \"kuadrant-operator-controller-manager-86878c769f-5wl2t\" (UID: \"371b2888-b90c-41b3-a801-ee1e91ed5ece\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.776654 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.776579 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ad7632a-c4ee-481a-9a3a-65b0e83d56bf" path="/var/lib/kubelet/pods/1ad7632a-c4ee-481a-9a3a-65b0e83d56bf/volumes" Jun 11 16:20:55.783871 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.783834 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:55.803803 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.803776 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:20:55.807175 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:20:55.807137 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e55c602_e6e9_4aea_8f06_9915af8bd23b.slice/crio-ecdb4d01b1c3e106ea665344b3ab3cce711627c8b29672e12ee5584a3de0b935 WatchSource:0}: Error finding container ecdb4d01b1c3e106ea665344b3ab3cce711627c8b29672e12ee5584a3de0b935: Status 404 returned error can't find the container with id ecdb4d01b1c3e106ea665344b3ab3cce711627c8b29672e12ee5584a3de0b935 Jun 11 16:20:55.939250 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:55.939211 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t"] Jun 11 16:20:55.943243 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:20:55.943216 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod371b2888_b90c_41b3_a801_ee1e91ed5ece.slice/crio-b1dfff09c03d9e7a136107a5011800ce0763de63d1b03ccf9c56128634cb897e WatchSource:0}: Error finding container b1dfff09c03d9e7a136107a5011800ce0763de63d1b03ccf9c56128634cb897e: Status 404 returned error can't find the container with id b1dfff09c03d9e7a136107a5011800ce0763de63d1b03ccf9c56128634cb897e Jun 11 16:20:56.017666 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.017640 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:56.119531 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.119455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:20:56.390686 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.390598 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-rv87x" Jun 11 16:20:56.390686 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.390630 2562 scope.go:117] "RemoveContainer" containerID="52a06e6da8e8eb8dcb61ea00eab9b3be300748312f921470d7f8015efc5561f7" Jun 11 16:20:56.392542 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.392501 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" event={"ID":"371b2888-b90c-41b3-a801-ee1e91ed5ece","Type":"ContainerStarted","Data":"c11406c61acb4f06cffc38e66b5455a75e18c6b37b34294bc6a8b6a2f926e6ab"} Jun 11 16:20:56.392651 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.392574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" event={"ID":"371b2888-b90c-41b3-a801-ee1e91ed5ece","Type":"ContainerStarted","Data":"b1dfff09c03d9e7a136107a5011800ce0763de63d1b03ccf9c56128634cb897e"} Jun 11 16:20:56.392715 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.392651 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:20:56.394282 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.394263 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" event={"ID":"7e55c602-e6e9-4aea-8f06-9915af8bd23b","Type":"ContainerStarted","Data":"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29"} Jun 11 16:20:56.394405 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.394297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" event={"ID":"7e55c602-e6e9-4aea-8f06-9915af8bd23b","Type":"ContainerStarted","Data":"ecdb4d01b1c3e106ea665344b3ab3cce711627c8b29672e12ee5584a3de0b935"} Jun 11 16:20:56.394466 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.394421 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:20:56.415194 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.415140 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" podStartSLOduration=1.415120076 podStartE2EDuration="1.415120076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:56.412817209 +0000 UTC m=+723.066789001" watchObservedRunningTime="2026-06-11 16:20:56.415120076 +0000 UTC m=+723.069091866" Jun 11 16:20:56.439034 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:56.438985 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" podStartSLOduration=1.438968869 podStartE2EDuration="1.438968869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:20:56.438066387 +0000 UTC m=+723.092038188" watchObservedRunningTime="2026-06-11 16:20:56.438968869 +0000 UTC m=+723.092940658" Jun 11 16:20:59.952981 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:20:59.952947 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:00.049408 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:00.049363 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:00.544906 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:00.544870 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:00.694221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:00.694188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:04.146717 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:04.146682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:04.246551 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:04.246523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:07.401852 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.401818 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:21:07.402257 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.401901 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-5wl2t" Jun 11 16:21:07.485450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.485419 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:21:07.485640 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.485618 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" podUID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" containerName="manager" containerID="cri-o://896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29" gracePeriod=10 Jun 11 16:21:07.726408 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.726362 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:21:07.909585 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.909497 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxbwm\" (UniqueName: \"kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm\") pod \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " Jun 11 16:21:07.909585 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.909541 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume\") pod \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\" (UID: \"7e55c602-e6e9-4aea-8f06-9915af8bd23b\") " Jun 11 16:21:07.909933 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.909908 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7e55c602-e6e9-4aea-8f06-9915af8bd23b" (UID: "7e55c602-e6e9-4aea-8f06-9915af8bd23b"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 16:21:07.911543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:07.911522 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm" (OuterVolumeSpecName: "kube-api-access-bxbwm") pod "7e55c602-e6e9-4aea-8f06-9915af8bd23b" (UID: "7e55c602-e6e9-4aea-8f06-9915af8bd23b"). InnerVolumeSpecName "kube-api-access-bxbwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:21:08.010068 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.010037 2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7e55c602-e6e9-4aea-8f06-9915af8bd23b-extensions-socket-volume\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:21:08.010068 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.010064 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxbwm\" (UniqueName: \"kubernetes.io/projected/7e55c602-e6e9-4aea-8f06-9915af8bd23b-kube-api-access-bxbwm\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:21:08.447187 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.447148 2562 generic.go:356] "Generic (PLEG): container finished" podID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" containerID="896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29" exitCode=0 Jun 11 16:21:08.447644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.447195 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" Jun 11 16:21:08.447644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.447213 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" event={"ID":"7e55c602-e6e9-4aea-8f06-9915af8bd23b","Type":"ContainerDied","Data":"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29"} Jun 11 16:21:08.447644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.447256 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d" event={"ID":"7e55c602-e6e9-4aea-8f06-9915af8bd23b","Type":"ContainerDied","Data":"ecdb4d01b1c3e106ea665344b3ab3cce711627c8b29672e12ee5584a3de0b935"} Jun 11 16:21:08.447644 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.447278 2562 scope.go:117] "RemoveContainer" containerID="896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29" Jun 11 16:21:08.456036 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.456016 2562 scope.go:117] "RemoveContainer" containerID="896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29" Jun 11 16:21:08.456329 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:21:08.456309 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29\": container with ID starting with 896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29 not found: ID does not exist" containerID="896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29" Jun 11 16:21:08.456449 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.456336 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29"} err="failed to get container status \"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29\": rpc error: code = NotFound desc = could not find container \"896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29\": container with ID starting with 896b9a34f8a9dfe1b11ce33d6853288046ee892b57d0c08793df5b168f8a5b29 not found: ID does not exist" Jun 11 16:21:08.497647 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.497616 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:21:08.503745 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:08.503723 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-h926d"] Jun 11 16:21:09.776268 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:09.776221 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" path="/var/lib/kubelet/pods/7e55c602-e6e9-4aea-8f06-9915af8bd23b/volumes" Jun 11 16:21:10.301917 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:10.301888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:10.402831 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:10.402801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:15.035139 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:15.035106 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:15.139428 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:15.139398 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:19.476455 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:19.476421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:23.889428 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.889378 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz"] Jun 11 16:21:23.889805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.889727 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" containerName="manager" Jun 11 16:21:23.889805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.889742 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" containerName="manager" Jun 11 16:21:23.889805 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.889798 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e55c602-e6e9-4aea-8f06-9915af8bd23b" containerName="manager" Jun 11 16:21:23.892180 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.892159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.894345 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.894319 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-k9w5k\"" Jun 11 16:21:23.905170 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.905145 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz"] Jun 11 16:21:23.921496 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.921458 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:23.930400 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930348 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930414 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930492 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930563 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqv26\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-kube-api-access-hqv26\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:23.930746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:23.930620 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031004 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.030972 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031004 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031011 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031032 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031093 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqv26\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-kube-api-access-hqv26\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031113 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031499 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031241 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031499 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031274 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031499 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031429 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-credential-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031499 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031476 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-socket\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031702 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031678 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-workload-certs\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.031807 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.031751 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-data\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.032024 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.032002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.033516 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.033496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-envoy\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.033770 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.033754 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-podinfo\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.039202 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.039174 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqv26\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-kube-api-access-hqv26\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.039362 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.039346 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a82691bd-3e22-4a0d-85cf-53e15f7316ec-istio-token\") pod \"maas-default-gateway-openshift-default-67497754f6-6wjkz\" (UID: \"a82691bd-3e22-4a0d-85cf-53e15f7316ec\") " pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.103224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.103191 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:24.201927 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.201839 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:24.373098 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.373066 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz"] Jun 11 16:21:24.377005 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:21:24.376978 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82691bd_3e22_4a0d_85cf_53e15f7316ec.slice/crio-067c32ab072ca7e814132d379a5063f02ba41517d6dcbddbb42930b4c377de98 WatchSource:0}: Error finding container 067c32ab072ca7e814132d379a5063f02ba41517d6dcbddbb42930b4c377de98: Status 404 returned error can't find the container with id 067c32ab072ca7e814132d379a5063f02ba41517d6dcbddbb42930b4c377de98 Jun 11 16:21:24.379193 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.379155 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:21:24.379293 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.379249 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:21:24.379336 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.379289 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:21:24.525303 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.525265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" event={"ID":"a82691bd-3e22-4a0d-85cf-53e15f7316ec","Type":"ContainerStarted","Data":"17188eb576d97fcf1af7cdb2aece312ddbeac1ceb56c12a3a9fb02a59a618c7b"} Jun 11 16:21:24.525506 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.525319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" event={"ID":"a82691bd-3e22-4a0d-85cf-53e15f7316ec","Type":"ContainerStarted","Data":"067c32ab072ca7e814132d379a5063f02ba41517d6dcbddbb42930b4c377de98"} Jun 11 16:21:24.551358 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:24.551300 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" podStartSLOduration=1.551278989 podStartE2EDuration="1.551278989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:24.549208527 +0000 UTC m=+751.203180318" watchObservedRunningTime="2026-06-11 16:21:24.551278989 +0000 UTC m=+751.205250784" Jun 11 16:21:25.202701 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.202666 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:25.207316 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.207291 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:25.529647 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.529615 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:25.530424 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.530382 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:21:25.568010 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.567964 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:25.686612 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.686576 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:25.782165 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:25.782062 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:26.433437 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.433402 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:26.436100 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.436072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:26.438640 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.438619 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x47qm\"" Jun 11 16:21:26.446077 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.446051 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:26.454953 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.454923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m695k\" (UniqueName: \"kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k\") pod \"authorino-58cd955675-4pnf9\" (UID: \"f1380fae-f8d7-4b6e-8583-574808edf8c4\") " pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:26.472546 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.472508 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:26.542278 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.542250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:26.555613 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.555573 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m695k\" (UniqueName: \"kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k\") pod \"authorino-58cd955675-4pnf9\" (UID: \"f1380fae-f8d7-4b6e-8583-574808edf8c4\") " pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:26.564316 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.564285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m695k\" (UniqueName: \"kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k\") pod \"authorino-58cd955675-4pnf9\" (UID: \"f1380fae-f8d7-4b6e-8583-574808edf8c4\") " pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:26.619661 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.619622 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:21:26.621882 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.621860 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:21:26.629479 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.629110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:21:26.656840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.656801 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mqkd\" (UniqueName: \"kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd\") pod \"authorino-75d556bd77-8cnlc\" (UID: \"e4edac77-f432-4934-b9c2-adc538043a51\") " pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:21:26.746088 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.746060 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:26.758361 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.758332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mqkd\" (UniqueName: \"kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd\") pod \"authorino-75d556bd77-8cnlc\" (UID: \"e4edac77-f432-4934-b9c2-adc538043a51\") " pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:21:26.766829 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.766806 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mqkd\" (UniqueName: \"kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd\") pod \"authorino-75d556bd77-8cnlc\" (UID: \"e4edac77-f432-4934-b9c2-adc538043a51\") " pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:21:26.875625 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.875584 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:26.879353 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:21:26.879326 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1380fae_f8d7_4b6e_8583_574808edf8c4.slice/crio-e749642c2d5854f53e7bb44aaa11457f11348340bca59b0e03c2cd7b5e2d3dac WatchSource:0}: Error finding container e749642c2d5854f53e7bb44aaa11457f11348340bca59b0e03c2cd7b5e2d3dac: Status 404 returned error can't find the container with id e749642c2d5854f53e7bb44aaa11457f11348340bca59b0e03c2cd7b5e2d3dac Jun 11 16:21:26.932436 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:26.932406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:21:27.060503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:27.060403 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:21:27.063006 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:21:27.062980 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode4edac77_f432_4934_b9c2_adc538043a51.slice/crio-c42a7e1cbb679e8d281c24879dc9e418b91eaf68fb4b7e2053401a82d997eab3 WatchSource:0}: Error finding container c42a7e1cbb679e8d281c24879dc9e418b91eaf68fb4b7e2053401a82d997eab3: Status 404 returned error can't find the container with id c42a7e1cbb679e8d281c24879dc9e418b91eaf68fb4b7e2053401a82d997eab3 Jun 11 16:21:27.539768 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:27.539738 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pnf9" event={"ID":"f1380fae-f8d7-4b6e-8583-574808edf8c4","Type":"ContainerStarted","Data":"e749642c2d5854f53e7bb44aaa11457f11348340bca59b0e03c2cd7b5e2d3dac"} Jun 11 16:21:27.540772 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:27.540748 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cnlc" event={"ID":"e4edac77-f432-4934-b9c2-adc538043a51","Type":"ContainerStarted","Data":"c42a7e1cbb679e8d281c24879dc9e418b91eaf68fb4b7e2053401a82d997eab3"} Jun 11 16:21:31.563658 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:31.563619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cnlc" event={"ID":"e4edac77-f432-4934-b9c2-adc538043a51","Type":"ContainerStarted","Data":"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e"} Jun 11 16:21:31.565083 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:31.565058 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pnf9" event={"ID":"f1380fae-f8d7-4b6e-8583-574808edf8c4","Type":"ContainerStarted","Data":"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4"} Jun 11 16:21:31.578719 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:31.578671 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-8cnlc" podStartSLOduration=1.984574106 podStartE2EDuration="5.578655013s" totalImagesPullingTime="3.594080907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:31.576776676 +0000 UTC m=+758.230748477" watchObservedRunningTime="2026-06-11 16:21:31.578655013 +0000 UTC m=+758.232626803" Jun 11 16:21:31.606367 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:31.606317 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4pnf9" podStartSLOduration=1.839711854 podStartE2EDuration="5.606302302s" totalImagesPullingTime="3.766590448s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:21:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:21:31.60334886 +0000 UTC m=+758.257320651" watchObservedRunningTime="2026-06-11 16:21:31.606302302 +0000 UTC m=+758.260274092" Jun 11 16:21:31.638024 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:31.637992 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:33.574351 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:33.574310 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4pnf9" podUID="f1380fae-f8d7-4b6e-8583-574808edf8c4" containerName="authorino" containerID="cri-o://b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4" gracePeriod=30 Jun 11 16:21:33.818037 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:33.818012 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:33.925730 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:33.925640 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m695k\" (UniqueName: \"kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k\") pod \"f1380fae-f8d7-4b6e-8583-574808edf8c4\" (UID: \"f1380fae-f8d7-4b6e-8583-574808edf8c4\") " Jun 11 16:21:33.927863 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:33.927840 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k" (OuterVolumeSpecName: "kube-api-access-m695k") pod "f1380fae-f8d7-4b6e-8583-574808edf8c4" (UID: "f1380fae-f8d7-4b6e-8583-574808edf8c4"). InnerVolumeSpecName "kube-api-access-m695k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:21:34.031200 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.026670 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m695k\" (UniqueName: \"kubernetes.io/projected/f1380fae-f8d7-4b6e-8583-574808edf8c4-kube-api-access-m695k\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:21:34.579905 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.579866 2562 generic.go:356] "Generic (PLEG): container finished" podID="f1380fae-f8d7-4b6e-8583-574808edf8c4" containerID="b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4" exitCode=0 Jun 11 16:21:34.580304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.579924 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4pnf9" Jun 11 16:21:34.580304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.579926 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pnf9" event={"ID":"f1380fae-f8d7-4b6e-8583-574808edf8c4","Type":"ContainerDied","Data":"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4"} Jun 11 16:21:34.580304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.580030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4pnf9" event={"ID":"f1380fae-f8d7-4b6e-8583-574808edf8c4","Type":"ContainerDied","Data":"e749642c2d5854f53e7bb44aaa11457f11348340bca59b0e03c2cd7b5e2d3dac"} Jun 11 16:21:34.580304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.580047 2562 scope.go:117] "RemoveContainer" containerID="b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4" Jun 11 16:21:34.588753 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.588733 2562 scope.go:117] "RemoveContainer" containerID="b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4" Jun 11 16:21:34.589022 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:21:34.589003 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4\": container with ID starting with b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4 not found: ID does not exist" containerID="b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4" Jun 11 16:21:34.589084 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.589035 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4"} err="failed to get container status \"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4\": rpc error: code = NotFound desc = could not find container \"b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4\": container with ID starting with b69ec15357cc3a6444846560ebf6d6ba5d0c1df913276f74a6ff5c5d2a0118e4 not found: ID does not exist" Jun 11 16:21:34.602682 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.602652 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:34.605489 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:34.605463 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4pnf9"] Jun 11 16:21:35.775289 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:35.775254 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1380fae-f8d7-4b6e-8583-574808edf8c4" path="/var/lib/kubelet/pods/f1380fae-f8d7-4b6e-8583-574808edf8c4/volumes" Jun 11 16:21:41.654795 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:41.654760 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:43.921992 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:43.921953 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:44.022551 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:44.022499 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:51.264212 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:51.264172 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:51.441875 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:51.441833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:21:51.591278 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:21:51.591184 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:19.226512 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.226470 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:19.326799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.326767 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:19.618279 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.618241 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:22:19.618578 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.618565 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1380fae-f8d7-4b6e-8583-574808edf8c4" containerName="authorino" Jun 11 16:22:19.618632 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.618580 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1380fae-f8d7-4b6e-8583-574808edf8c4" containerName="authorino" Jun 11 16:22:19.618632 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.618628 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1380fae-f8d7-4b6e-8583-574808edf8c4" containerName="authorino" Jun 11 16:22:19.620374 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.620358 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:19.622710 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.622690 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:22:19.622837 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.622721 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:22:19.622837 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.622698 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:22:19.623191 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.623175 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-c5xnr\"" Jun 11 16:22:19.635627 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.635593 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:22:19.733702 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.733669 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrm8l\" (UniqueName: \"kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l\") pod \"maas-keycloak-0\" (UID: \"16615002-26c6-43bb-b215-2db6146f281e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:19.834524 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.834492 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrm8l\" (UniqueName: \"kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l\") pod \"maas-keycloak-0\" (UID: \"16615002-26c6-43bb-b215-2db6146f281e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:19.843427 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.843403 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrm8l\" (UniqueName: \"kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l\") pod \"maas-keycloak-0\" (UID: \"16615002-26c6-43bb-b215-2db6146f281e\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:19.929991 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:19.929903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:20.071220 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:20.071198 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:22:20.073861 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:22:20.073831 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16615002_26c6_43bb_b215_2db6146f281e.slice/crio-17b74194c495f7116f519d5e2dc746705a341935adcba576c5d3e4f5bbbbc25f WatchSource:0}: Error finding container 17b74194c495f7116f519d5e2dc746705a341935adcba576c5d3e4f5bbbbc25f: Status 404 returned error can't find the container with id 17b74194c495f7116f519d5e2dc746705a341935adcba576c5d3e4f5bbbbc25f Jun 11 16:22:20.784153 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:20.784106 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16615002-26c6-43bb-b215-2db6146f281e","Type":"ContainerStarted","Data":"17b74194c495f7116f519d5e2dc746705a341935adcba576c5d3e4f5bbbbc25f"} Jun 11 16:22:28.830553 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:28.830507 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16615002-26c6-43bb-b215-2db6146f281e","Type":"ContainerStarted","Data":"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4"} Jun 11 16:22:28.853693 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:28.853630 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.9933742479999998 podStartE2EDuration="9.853612742s" totalImagesPullingTime="7.860238494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:22:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:28.851039306 +0000 UTC m=+815.505011097" watchObservedRunningTime="2026-06-11 16:22:28.853612742 +0000 UTC m=+815.507584531" Jun 11 16:22:28.931108 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:28.930809 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:28.932802 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:28.932768 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:29.930366 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:29.930324 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:29.931025 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:29.930981 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:30.931326 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:30.930848 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:31.931070 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:31.931021 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:32.931023 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:32.930972 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:33.930567 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:33.930519 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:34.931425 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:34.931358 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:35.930825 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:35.930773 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:36.931374 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:36.931321 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:37.930881 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:37.930830 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:38.931006 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:38.930950 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:39.930457 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:39.930419 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:40.931286 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:40.931235 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.32:9000/health/started\": dial tcp 10.133.0.32:9000: connect: connection refused" Jun 11 16:22:42.060545 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:42.059954 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:42.079523 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:42.079461 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:22:52.067277 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:52.067240 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:22:52.745942 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:52.745909 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:52.988919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:52.988886 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:52.997256 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:52.997196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:53.001437 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.001411 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:53.036093 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.036060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njd5t\" (UniqueName: \"kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t\") pod \"authorino-5d4b67c446-vnv2k\" (UID: \"ee71655c-d191-4f85-9b77-d8bcfdf87f72\") " pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:53.134340 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.134305 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:53.136556 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.136535 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njd5t\" (UniqueName: \"kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t\") pod \"authorino-5d4b67c446-vnv2k\" (UID: \"ee71655c-d191-4f85-9b77-d8bcfdf87f72\") " pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:53.144800 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.144778 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njd5t\" (UniqueName: \"kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t\") pod \"authorino-5d4b67c446-vnv2k\" (UID: \"ee71655c-d191-4f85-9b77-d8bcfdf87f72\") " pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:53.209578 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.209551 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:53.209801 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.209789 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:53.241724 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.241693 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f8557d458-v5pm9"] Jun 11 16:22:53.246922 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.246885 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.258753 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.258728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f8557d458-v5pm9"] Jun 11 16:22:53.338159 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.338124 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbtgk\" (UniqueName: \"kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk\") pod \"authorino-6f8557d458-v5pm9\" (UID: \"a658ac91-d2f9-42e1-af92-87857ad3c3ad\") " pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.346411 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.346369 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:53.349085 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:22:53.349051 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee71655c_d191_4f85_9b77_d8bcfdf87f72.slice/crio-5ace6946e786fa98225d28c9777b14b370f647f47224bbc7c1c1a95dd7ec74e1 WatchSource:0}: Error finding container 5ace6946e786fa98225d28c9777b14b370f647f47224bbc7c1c1a95dd7ec74e1: Status 404 returned error can't find the container with id 5ace6946e786fa98225d28c9777b14b370f647f47224bbc7c1c1a95dd7ec74e1 Jun 11 16:22:53.431543 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.431507 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f8557d458-v5pm9"] Jun 11 16:22:53.431798 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:22:53.431778 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-kbtgk], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6f8557d458-v5pm9" podUID="a658ac91-d2f9-42e1-af92-87857ad3c3ad" Jun 11 16:22:53.439065 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.439028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbtgk\" (UniqueName: \"kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk\") pod \"authorino-6f8557d458-v5pm9\" (UID: \"a658ac91-d2f9-42e1-af92-87857ad3c3ad\") " pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.454982 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.454960 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbtgk\" (UniqueName: \"kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk\") pod \"authorino-6f8557d458-v5pm9\" (UID: \"a658ac91-d2f9-42e1-af92-87857ad3c3ad\") " pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.469209 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.469186 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:22:53.472612 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.472594 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.474766 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.474747 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 16:22:53.481138 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.481118 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:22:53.539746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.539652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.539746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.539718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tps9l\" (UniqueName: \"kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.640851 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.640822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.641021 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.640870 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tps9l\" (UniqueName: \"kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.643224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.643195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.651571 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.651547 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tps9l\" (UniqueName: \"kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l\") pod \"authorino-64668f4678-bchks\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.782747 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.782721 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:22:53.931801 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.931774 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:22:53.934421 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:22:53.934377 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0f1c782_287c_4cf8_89ad_a856e4580f0e.slice/crio-51c6ec3947c4106899c6d726c4669d25fc1dead766633d831965478bbbe6316d WatchSource:0}: Error finding container 51c6ec3947c4106899c6d726c4669d25fc1dead766633d831965478bbbe6316d: Status 404 returned error can't find the container with id 51c6ec3947c4106899c6d726c4669d25fc1dead766633d831965478bbbe6316d Jun 11 16:22:53.961220 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.961185 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" event={"ID":"ee71655c-d191-4f85-9b77-d8bcfdf87f72","Type":"ContainerStarted","Data":"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13"} Jun 11 16:22:53.961372 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.961228 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" event={"ID":"ee71655c-d191-4f85-9b77-d8bcfdf87f72","Type":"ContainerStarted","Data":"5ace6946e786fa98225d28c9777b14b370f647f47224bbc7c1c1a95dd7ec74e1"} Jun 11 16:22:53.961372 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.961185 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" podUID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" containerName="authorino" containerID="cri-o://be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13" gracePeriod=30 Jun 11 16:22:53.962441 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.962416 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64668f4678-bchks" event={"ID":"d0f1c782-287c-4cf8-89ad-a856e4580f0e","Type":"ContainerStarted","Data":"51c6ec3947c4106899c6d726c4669d25fc1dead766633d831965478bbbe6316d"} Jun 11 16:22:53.962541 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.962426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.969781 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.969755 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:53.978584 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:53.978542 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" podStartSLOduration=1.652605258 podStartE2EDuration="1.97852594s" totalImagesPullingTime="325.920682ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:22:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:53.976976036 +0000 UTC m=+840.630947824" watchObservedRunningTime="2026-06-11 16:22:53.97852594 +0000 UTC m=+840.632497730" Jun 11 16:22:54.043503 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.043473 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbtgk\" (UniqueName: \"kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk\") pod \"a658ac91-d2f9-42e1-af92-87857ad3c3ad\" (UID: \"a658ac91-d2f9-42e1-af92-87857ad3c3ad\") " Jun 11 16:22:54.045497 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.045445 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk" (OuterVolumeSpecName: "kube-api-access-kbtgk") pod "a658ac91-d2f9-42e1-af92-87857ad3c3ad" (UID: "a658ac91-d2f9-42e1-af92-87857ad3c3ad"). InnerVolumeSpecName "kube-api-access-kbtgk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:54.144297 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.144265 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbtgk\" (UniqueName: \"kubernetes.io/projected/a658ac91-d2f9-42e1-af92-87857ad3c3ad-kube-api-access-kbtgk\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:22:54.203566 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.203541 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:54.244598 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.244573 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njd5t\" (UniqueName: \"kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t\") pod \"ee71655c-d191-4f85-9b77-d8bcfdf87f72\" (UID: \"ee71655c-d191-4f85-9b77-d8bcfdf87f72\") " Jun 11 16:22:54.246602 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.246577 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t" (OuterVolumeSpecName: "kube-api-access-njd5t") pod "ee71655c-d191-4f85-9b77-d8bcfdf87f72" (UID: "ee71655c-d191-4f85-9b77-d8bcfdf87f72"). InnerVolumeSpecName "kube-api-access-njd5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:54.346025 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.345994 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njd5t\" (UniqueName: \"kubernetes.io/projected/ee71655c-d191-4f85-9b77-d8bcfdf87f72-kube-api-access-njd5t\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:22:54.968463 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.968425 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64668f4678-bchks" event={"ID":"d0f1c782-287c-4cf8-89ad-a856e4580f0e","Type":"ContainerStarted","Data":"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428"} Jun 11 16:22:54.969607 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969579 2562 generic.go:356] "Generic (PLEG): container finished" podID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" containerID="be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13" exitCode=0 Jun 11 16:22:54.969728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969608 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" Jun 11 16:22:54.969728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969650 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" event={"ID":"ee71655c-d191-4f85-9b77-d8bcfdf87f72","Type":"ContainerDied","Data":"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13"} Jun 11 16:22:54.969728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-vnv2k" event={"ID":"ee71655c-d191-4f85-9b77-d8bcfdf87f72","Type":"ContainerDied","Data":"5ace6946e786fa98225d28c9777b14b370f647f47224bbc7c1c1a95dd7ec74e1"} Jun 11 16:22:54.969728 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969695 2562 scope.go:117] "RemoveContainer" containerID="be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13" Jun 11 16:22:54.969878 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.969811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f8557d458-v5pm9" Jun 11 16:22:54.979140 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.979123 2562 scope.go:117] "RemoveContainer" containerID="be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13" Jun 11 16:22:54.979412 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:22:54.979377 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13\": container with ID starting with be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13 not found: ID does not exist" containerID="be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13" Jun 11 16:22:54.979468 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.979422 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13"} err="failed to get container status \"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13\": rpc error: code = NotFound desc = could not find container \"be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13\": container with ID starting with be761c260d6dbe799984aae30ffd8f200e8b615e2c0cd87c225e235580b39a13 not found: ID does not exist" Jun 11 16:22:54.987952 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:54.987911 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64668f4678-bchks" podStartSLOduration=1.673715578 podStartE2EDuration="1.987897392s" totalImagesPullingTime="314.181814ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:22:54.986538548 +0000 UTC m=+841.640510338" watchObservedRunningTime="2026-06-11 16:22:54.987897392 +0000 UTC m=+841.641869181" Jun 11 16:22:55.017183 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.017149 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f8557d458-v5pm9"] Jun 11 16:22:55.023168 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.023143 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f8557d458-v5pm9"] Jun 11 16:22:55.029581 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.029542 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:22:55.029756 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.029733 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-8cnlc" podUID="e4edac77-f432-4934-b9c2-adc538043a51" containerName="authorino" containerID="cri-o://2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e" gracePeriod=30 Jun 11 16:22:55.050185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.049493 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:55.052040 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.052014 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-vnv2k"] Jun 11 16:22:55.276072 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.276045 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:22:55.355449 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.355420 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mqkd\" (UniqueName: \"kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd\") pod \"e4edac77-f432-4934-b9c2-adc538043a51\" (UID: \"e4edac77-f432-4934-b9c2-adc538043a51\") " Jun 11 16:22:55.357423 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.357374 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd" (OuterVolumeSpecName: "kube-api-access-8mqkd") pod "e4edac77-f432-4934-b9c2-adc538043a51" (UID: "e4edac77-f432-4934-b9c2-adc538043a51"). InnerVolumeSpecName "kube-api-access-8mqkd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:22:55.456366 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.456335 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mqkd\" (UniqueName: \"kubernetes.io/projected/e4edac77-f432-4934-b9c2-adc538043a51-kube-api-access-8mqkd\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:22:55.775256 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.775223 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a658ac91-d2f9-42e1-af92-87857ad3c3ad" path="/var/lib/kubelet/pods/a658ac91-d2f9-42e1-af92-87857ad3c3ad/volumes" Jun 11 16:22:55.775471 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.775458 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" path="/var/lib/kubelet/pods/ee71655c-d191-4f85-9b77-d8bcfdf87f72/volumes" Jun 11 16:22:55.975444 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.975407 2562 generic.go:356] "Generic (PLEG): container finished" podID="e4edac77-f432-4934-b9c2-adc538043a51" containerID="2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e" exitCode=0 Jun 11 16:22:55.975444 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.975452 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-8cnlc" Jun 11 16:22:55.975690 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.975482 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cnlc" event={"ID":"e4edac77-f432-4934-b9c2-adc538043a51","Type":"ContainerDied","Data":"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e"} Jun 11 16:22:55.975690 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.975521 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-8cnlc" event={"ID":"e4edac77-f432-4934-b9c2-adc538043a51","Type":"ContainerDied","Data":"c42a7e1cbb679e8d281c24879dc9e418b91eaf68fb4b7e2053401a82d997eab3"} Jun 11 16:22:55.975690 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.975539 2562 scope.go:117] "RemoveContainer" containerID="2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e" Jun 11 16:22:55.984079 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.984061 2562 scope.go:117] "RemoveContainer" containerID="2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e" Jun 11 16:22:55.984396 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:22:55.984361 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e\": container with ID starting with 2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e not found: ID does not exist" containerID="2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e" Jun 11 16:22:55.984456 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.984413 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e"} err="failed to get container status \"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e\": rpc error: code = NotFound desc = could not find container \"2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e\": container with ID starting with 2ba9cb7b4daf350276dc5f47fcac526eae4f2c468f31b21e208076f13aaffb4e not found: ID does not exist" Jun 11 16:22:55.997787 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:55.997758 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:22:56.000571 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:56.000547 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-8cnlc"] Jun 11 16:22:57.776033 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:57.776003 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4edac77-f432-4934-b9c2-adc538043a51" path="/var/lib/kubelet/pods/e4edac77-f432-4934-b9c2-adc538043a51/volumes" Jun 11 16:22:58.793230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.793197 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:58.849781 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.849748 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:22:58.850064 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850053 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" containerName="authorino" Jun 11 16:22:58.850122 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850066 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" containerName="authorino" Jun 11 16:22:58.850122 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850081 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4edac77-f432-4934-b9c2-adc538043a51" containerName="authorino" Jun 11 16:22:58.850122 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850086 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4edac77-f432-4934-b9c2-adc538043a51" containerName="authorino" Jun 11 16:22:58.850211 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850142 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4edac77-f432-4934-b9c2-adc538043a51" containerName="authorino" Jun 11 16:22:58.850211 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.850149 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee71655c-d191-4f85-9b77-d8bcfdf87f72" containerName="authorino" Jun 11 16:22:58.854369 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.854350 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:58.859147 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.859123 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 16:22:58.859265 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.859198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sv65v\"" Jun 11 16:22:58.862033 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.862010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 16:22:58.868204 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.868180 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:22:58.883490 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.883460 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:58.883606 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.883531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q65hf\" (UniqueName: \"kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:58.929611 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.929581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:58.984984 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.984948 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q65hf\" (UniqueName: \"kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:58.985156 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.985004 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:58.985156 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:22:58.985115 2562 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 11 16:22:58.985249 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:22:58.985170 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert podName:7341bba0-6e7d-4541-b167-e44320189e37 nodeName:}" failed. No retries permitted until 2026-06-11 16:22:59.485153863 +0000 UTC m=+846.139125631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert") pod "maas-controller-bcd47fc69-25dds" (UID: "7341bba0-6e7d-4541-b167-e44320189e37") : secret "maas-controller-webhook-cert" not found Jun 11 16:22:58.997583 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:58.997552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q65hf\" (UniqueName: \"kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:59.033721 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.033685 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:59.396143 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.396105 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:22:59.488699 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.488648 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:59.491046 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.491014 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") pod \"maas-controller-bcd47fc69-25dds\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:59.768376 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.768338 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:22:59.908262 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.908229 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:22:59.910909 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:22:59.910882 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7341bba0_6e7d_4541_b167_e44320189e37.slice/crio-967433edbed3a809a8cba4d1821455d92ad585923434d8eff50e1a4535fc4104 WatchSource:0}: Error finding container 967433edbed3a809a8cba4d1821455d92ad585923434d8eff50e1a4535fc4104: Status 404 returned error can't find the container with id 967433edbed3a809a8cba4d1821455d92ad585923434d8eff50e1a4535fc4104 Jun 11 16:22:59.998322 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:22:59.998285 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcd47fc69-25dds" event={"ID":"7341bba0-6e7d-4541-b167-e44320189e37","Type":"ContainerStarted","Data":"967433edbed3a809a8cba4d1821455d92ad585923434d8eff50e1a4535fc4104"} Jun 11 16:23:02.635509 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:02.635468 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:02.766918 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:02.766887 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:04.019776 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:04.019742 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcd47fc69-25dds" event={"ID":"7341bba0-6e7d-4541-b167-e44320189e37","Type":"ContainerStarted","Data":"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023"} Jun 11 16:23:04.020223 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:04.019888 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:23:04.038842 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:04.038795 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-bcd47fc69-25dds" podStartSLOduration=2.510551045 podStartE2EDuration="6.038777803s" totalImagesPullingTime="3.528226758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:04.037423283 +0000 UTC m=+850.691395067" watchObservedRunningTime="2026-06-11 16:23:04.038777803 +0000 UTC m=+850.692749592" Jun 11 16:23:13.527046 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.527011 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:23:13.527509 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.527215 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-bcd47fc69-25dds" podUID="7341bba0-6e7d-4541-b167-e44320189e37" containerName="manager" containerID="cri-o://b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023" gracePeriod=30 Jun 11 16:23:13.535622 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.535593 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:23:13.775653 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.775630 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:23:13.916163 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.916128 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q65hf\" (UniqueName: \"kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf\") pod \"7341bba0-6e7d-4541-b167-e44320189e37\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " Jun 11 16:23:13.916332 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.916311 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") pod \"7341bba0-6e7d-4541-b167-e44320189e37\" (UID: \"7341bba0-6e7d-4541-b167-e44320189e37\") " Jun 11 16:23:13.918401 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.918358 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7341bba0-6e7d-4541-b167-e44320189e37" (UID: "7341bba0-6e7d-4541-b167-e44320189e37"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:23:13.918522 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:13.918444 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf" (OuterVolumeSpecName: "kube-api-access-q65hf") pod "7341bba0-6e7d-4541-b167-e44320189e37" (UID: "7341bba0-6e7d-4541-b167-e44320189e37"). InnerVolumeSpecName "kube-api-access-q65hf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:23:14.017007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.016974 2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7341bba0-6e7d-4541-b167-e44320189e37-webhook-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:23:14.017007 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.016999 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q65hf\" (UniqueName: \"kubernetes.io/projected/7341bba0-6e7d-4541-b167-e44320189e37-kube-api-access-q65hf\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:23:14.065967 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.065888 2562 generic.go:356] "Generic (PLEG): container finished" podID="7341bba0-6e7d-4541-b167-e44320189e37" containerID="b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023" exitCode=0 Jun 11 16:23:14.065967 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.065937 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-bcd47fc69-25dds" Jun 11 16:23:14.066121 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.065977 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcd47fc69-25dds" event={"ID":"7341bba0-6e7d-4541-b167-e44320189e37","Type":"ContainerDied","Data":"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023"} Jun 11 16:23:14.066121 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.066034 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-bcd47fc69-25dds" event={"ID":"7341bba0-6e7d-4541-b167-e44320189e37","Type":"ContainerDied","Data":"967433edbed3a809a8cba4d1821455d92ad585923434d8eff50e1a4535fc4104"} Jun 11 16:23:14.066121 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.066059 2562 scope.go:117] "RemoveContainer" containerID="b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023" Jun 11 16:23:14.074975 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.074957 2562 scope.go:117] "RemoveContainer" containerID="b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023" Jun 11 16:23:14.075200 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:23:14.075178 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023\": container with ID starting with b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023 not found: ID does not exist" containerID="b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023" Jun 11 16:23:14.075243 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.075208 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023"} err="failed to get container status \"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023\": rpc error: code = NotFound desc = could not find container \"b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023\": container with ID starting with b0406568c7945e041face5dda65d590a1f442eaf7a22c2fe58f99be5c5aad023 not found: ID does not exist" Jun 11 16:23:14.087528 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.087503 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:23:14.091865 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:14.091845 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-bcd47fc69-25dds"] Jun 11 16:23:15.775450 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:15.775414 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7341bba0-6e7d-4541-b167-e44320189e37" path="/var/lib/kubelet/pods/7341bba0-6e7d-4541-b167-e44320189e37/volumes" Jun 11 16:23:33.791234 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.791200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:33.891229 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.891181 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8499f7f9d-pwjvq"] Jun 11 16:23:33.891568 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.891552 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7341bba0-6e7d-4541-b167-e44320189e37" containerName="manager" Jun 11 16:23:33.891630 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.891570 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7341bba0-6e7d-4541-b167-e44320189e37" containerName="manager" Jun 11 16:23:33.891669 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.891646 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7341bba0-6e7d-4541-b167-e44320189e37" containerName="manager" Jun 11 16:23:33.900006 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.899986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:33.903108 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.903082 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-cxvqj\"" Jun 11 16:23:33.903222 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.903091 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 16:23:33.906140 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.906118 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8499f7f9d-pwjvq"] Jun 11 16:23:33.992602 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.992572 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-openshift-service-ca\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:33.992711 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.992618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpx9l\" (UniqueName: \"kubernetes.io/projected/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-kube-api-access-kpx9l\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:33.992711 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:33.992637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.093771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.093690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-openshift-service-ca\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.093771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.093734 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpx9l\" (UniqueName: \"kubernetes.io/projected/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-kube-api-access-kpx9l\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.093771 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.093763 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.094020 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:23:34.093938 2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found Jun 11 16:23:34.094020 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:23:34.094010 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls podName:911a514c-3ac1-4fbc-ad49-7ccc3c553dba nodeName:}" failed. No retries permitted until 2026-06-11 16:23:34.593993598 +0000 UTC m=+881.247965366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls") pod "maas-api-8499f7f9d-pwjvq" (UID: "911a514c-3ac1-4fbc-ad49-7ccc3c553dba") : secret "maas-api-serving-cert" not found Jun 11 16:23:34.094400 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.094365 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-openshift-service-ca\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.103845 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.103815 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpx9l\" (UniqueName: \"kubernetes.io/projected/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-kube-api-access-kpx9l\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.267221 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.267186 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:34.367067 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.366981 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:34.390315 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.390271 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vp8cd"] Jun 11 16:23:34.394501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.394473 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:34.397445 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.397418 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 11 16:23:34.397607 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.397589 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-6pb4r\"" Jun 11 16:23:34.407497 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.407470 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vp8cd"] Jun 11 16:23:34.486559 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.486523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:34.498205 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.498176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dcwn\" (UniqueName: \"kubernetes.io/projected/035334ac-7213-47c1-8573-81d075b891a6-kube-api-access-4dcwn\") pod \"payload-pre-processing-579785bc64-vp8cd\" (UID: \"035334ac-7213-47c1-8573-81d075b891a6\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:34.599674 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.599632 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dcwn\" (UniqueName: \"kubernetes.io/projected/035334ac-7213-47c1-8573-81d075b891a6-kube-api-access-4dcwn\") pod \"payload-pre-processing-579785bc64-vp8cd\" (UID: \"035334ac-7213-47c1-8573-81d075b891a6\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:34.599854 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.599741 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.602083 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.602060 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/911a514c-3ac1-4fbc-ad49-7ccc3c553dba-maas-api-tls\") pod \"maas-api-8499f7f9d-pwjvq\" (UID: \"911a514c-3ac1-4fbc-ad49-7ccc3c553dba\") " pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.609866 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.609840 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dcwn\" (UniqueName: \"kubernetes.io/projected/035334ac-7213-47c1-8573-81d075b891a6-kube-api-access-4dcwn\") pod \"payload-pre-processing-579785bc64-vp8cd\" (UID: \"035334ac-7213-47c1-8573-81d075b891a6\") " pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:34.705630 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.705536 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:34.840095 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.840059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:34.843027 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.843001 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-vp8cd"] Jun 11 16:23:34.845500 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:23:34.845477 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod035334ac_7213_47c1_8573_81d075b891a6.slice/crio-39bd00a32ac70c8030388ad6cee08fbb965519a5dfa1aa0f2932d68bc530dda6 WatchSource:0}: Error finding container 39bd00a32ac70c8030388ad6cee08fbb965519a5dfa1aa0f2932d68bc530dda6: Status 404 returned error can't find the container with id 39bd00a32ac70c8030388ad6cee08fbb965519a5dfa1aa0f2932d68bc530dda6 Jun 11 16:23:34.975375 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:34.975303 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8499f7f9d-pwjvq"] Jun 11 16:23:34.978412 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:23:34.978371 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911a514c_3ac1_4fbc_ad49_7ccc3c553dba.slice/crio-d366af38450f3103425f80e3e8e07027eff4528f22171245ef503510c71b758b WatchSource:0}: Error finding container d366af38450f3103425f80e3e8e07027eff4528f22171245ef503510c71b758b: Status 404 returned error can't find the container with id d366af38450f3103425f80e3e8e07027eff4528f22171245ef503510c71b758b Jun 11 16:23:35.165160 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:35.165118 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" event={"ID":"035334ac-7213-47c1-8573-81d075b891a6","Type":"ContainerStarted","Data":"39bd00a32ac70c8030388ad6cee08fbb965519a5dfa1aa0f2932d68bc530dda6"} Jun 11 16:23:35.166711 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:35.166675 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8499f7f9d-pwjvq" event={"ID":"911a514c-3ac1-4fbc-ad49-7ccc3c553dba","Type":"ContainerStarted","Data":"d366af38450f3103425f80e3e8e07027eff4528f22171245ef503510c71b758b"} Jun 11 16:23:37.100448 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:37.100300 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:37.201681 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:37.201641 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:39.188313 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.188276 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" event={"ID":"035334ac-7213-47c1-8573-81d075b891a6","Type":"ContainerStarted","Data":"9477dbb74de089c75802219c5f9fa81aec1682626bab9b7f8ff15b18055e6112"} Jun 11 16:23:39.188815 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.188415 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:39.189799 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.189773 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8499f7f9d-pwjvq" event={"ID":"911a514c-3ac1-4fbc-ad49-7ccc3c553dba","Type":"ContainerStarted","Data":"0f253738867ef826c6e0bc0d7dd9e061ff854d33d9194fea8ce1ef2f5bb115be"} Jun 11 16:23:39.190017 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.189822 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:39.225004 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.224935 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" podStartSLOduration=1.929458611 podStartE2EDuration="5.224914663s" totalImagesPullingTime="3.295456052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:39.22284464 +0000 UTC m=+885.876816432" watchObservedRunningTime="2026-06-11 16:23:39.224914663 +0000 UTC m=+885.878886455" Jun 11 16:23:39.249297 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:39.249244 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8499f7f9d-pwjvq" podStartSLOduration=3.085638068 podStartE2EDuration="6.249228837s" totalImagesPullingTime="3.163590769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:23:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:23:39.247830917 +0000 UTC m=+885.901802706" watchObservedRunningTime="2026-06-11 16:23:39.249228837 +0000 UTC m=+885.903200627" Jun 11 16:23:41.570564 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:41.570522 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-6wjkz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jun 11 16:23:41.570977 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:41.570599 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" podUID="a82691bd-3e22-4a0d-85cf-53e15f7316ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jun 11 16:23:42.205590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.205500 2562 generic.go:356] "Generic (PLEG): container finished" podID="a82691bd-3e22-4a0d-85cf-53e15f7316ec" containerID="17188eb576d97fcf1af7cdb2aece312ddbeac1ceb56c12a3a9fb02a59a618c7b" exitCode=0 Jun 11 16:23:42.205590 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.205575 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" event={"ID":"a82691bd-3e22-4a0d-85cf-53e15f7316ec","Type":"ContainerDied","Data":"17188eb576d97fcf1af7cdb2aece312ddbeac1ceb56c12a3a9fb02a59a618c7b"} Jun 11 16:23:42.205994 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.205978 2562 scope.go:117] "RemoveContainer" containerID="17188eb576d97fcf1af7cdb2aece312ddbeac1ceb56c12a3a9fb02a59a618c7b" Jun 11 16:23:42.207053 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.207027 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:23:42.207130 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.207113 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:23:42.207179 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:42.207163 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 11 16:23:43.211586 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:43.211542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" event={"ID":"a82691bd-3e22-4a0d-85cf-53e15f7316ec","Type":"ContainerStarted","Data":"c68187d8575bff441956e123af4cf7cf9fbd6cbcbb0c09b1da70ad2cf71849be"} Jun 11 16:23:44.202749 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:44.202713 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:23:44.202931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:44.202910 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-6wjkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jun 11 16:23:44.203026 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:44.202951 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" podUID="a82691bd-3e22-4a0d-85cf-53e15f7316ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jun 11 16:23:45.200344 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:45.200313 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8499f7f9d-pwjvq" Jun 11 16:23:45.203001 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:45.202977 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-6wjkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jun 11 16:23:45.203066 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:45.203032 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" podUID="a82691bd-3e22-4a0d-85cf-53e15f7316ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jun 11 16:23:46.202810 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:46.202768 2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-67497754f6-6wjkz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jun 11 16:23:46.203215 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:46.202834 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" podUID="a82691bd-3e22-4a0d-85cf-53e15f7316ec" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jun 11 16:23:47.206133 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:47.206101 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:23:47.206540 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:47.206445 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:23:47.207075 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:47.207058 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-67497754f6-6wjkz" Jun 11 16:23:50.045493 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:50.045438 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:23:50.196572 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:50.196542 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-vp8cd" Jun 11 16:23:53.769271 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:53.769241 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:23:53.777147 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:23:53.777119 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:24:10.169988 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:24:10.169945 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:25:49.415476 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:49.415434 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:49.416020 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:49.415663 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" containerID="cri-o://7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4" gracePeriod=30 Jun 11 16:25:51.065487 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.065461 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.078760 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.078734 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrm8l\" (UniqueName: \"kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l\") pod \"16615002-26c6-43bb-b215-2db6146f281e\" (UID: \"16615002-26c6-43bb-b215-2db6146f281e\") " Jun 11 16:25:51.080886 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.080858 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l" (OuterVolumeSpecName: "kube-api-access-rrm8l") pod "16615002-26c6-43bb-b215-2db6146f281e" (UID: "16615002-26c6-43bb-b215-2db6146f281e"). InnerVolumeSpecName "kube-api-access-rrm8l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:25:51.179508 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.179463 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrm8l\" (UniqueName: \"kubernetes.io/projected/16615002-26c6-43bb-b215-2db6146f281e-kube-api-access-rrm8l\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:25:51.802583 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.802548 2562 generic.go:356] "Generic (PLEG): container finished" podID="16615002-26c6-43bb-b215-2db6146f281e" containerID="7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4" exitCode=143 Jun 11 16:25:51.802735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.802593 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.802735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.802636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16615002-26c6-43bb-b215-2db6146f281e","Type":"ContainerDied","Data":"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4"} Jun 11 16:25:51.802735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.802692 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"16615002-26c6-43bb-b215-2db6146f281e","Type":"ContainerDied","Data":"17b74194c495f7116f519d5e2dc746705a341935adcba576c5d3e4f5bbbbc25f"} Jun 11 16:25:51.802735 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.802720 2562 scope.go:117] "RemoveContainer" containerID="7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4" Jun 11 16:25:51.811666 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.811640 2562 scope.go:117] "RemoveContainer" containerID="7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4" Jun 11 16:25:51.811912 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:25:51.811894 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4\": container with ID starting with 7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4 not found: ID does not exist" containerID="7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4" Jun 11 16:25:51.811959 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.811922 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4"} err="failed to get container status \"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4\": rpc error: code = NotFound desc = could not find container \"7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4\": container with ID starting with 7d5f119fb9e8fa49cdb0b6b4587cad8227f1c796f9effcc31303c91ab3611aa4 not found: ID does not exist" Jun 11 16:25:51.819118 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.819096 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:51.824116 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.824093 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:51.854592 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.854518 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:51.854853 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.854838 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" Jun 11 16:25:51.854897 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.854854 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" Jun 11 16:25:51.854946 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.854908 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="16615002-26c6-43bb-b215-2db6146f281e" containerName="keycloak" Jun 11 16:25:51.859282 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.859266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.861811 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.861794 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 16:25:51.861911 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.861806 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 16:25:51.861911 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.861887 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-c5xnr\"" Jun 11 16:25:51.862139 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.862123 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 16:25:51.862626 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.862610 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 16:25:51.866723 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.866581 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:51.883838 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.883811 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a3c2526d-9bf6-43c2-abda-787381c25449-test-realms\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.883993 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.883888 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb5jx\" (UniqueName: \"kubernetes.io/projected/a3c2526d-9bf6-43c2-abda-787381c25449-kube-api-access-wb5jx\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.984751 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.984710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a3c2526d-9bf6-43c2-abda-787381c25449-test-realms\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.984958 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.984804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb5jx\" (UniqueName: \"kubernetes.io/projected/a3c2526d-9bf6-43c2-abda-787381c25449-kube-api-access-wb5jx\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.985508 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.985487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/a3c2526d-9bf6-43c2-abda-787381c25449-test-realms\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:51.994637 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:51.994618 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb5jx\" (UniqueName: \"kubernetes.io/projected/a3c2526d-9bf6-43c2-abda-787381c25449-kube-api-access-wb5jx\") pod \"maas-keycloak-0\" (UID: \"a3c2526d-9bf6-43c2-abda-787381c25449\") " pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:52.169904 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.169808 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:52.305748 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.305715 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 16:25:52.310221 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:25:52.310194 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3c2526d_9bf6_43c2_abda_787381c25449.slice/crio-557a85198bd1def101d86d01cb4b006d83654a4e8e03f8ea4bc679db4db9b26e WatchSource:0}: Error finding container 557a85198bd1def101d86d01cb4b006d83654a4e8e03f8ea4bc679db4db9b26e: Status 404 returned error can't find the container with id 557a85198bd1def101d86d01cb4b006d83654a4e8e03f8ea4bc679db4db9b26e Jun 11 16:25:52.311501 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.311483 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:25:52.809429 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.809374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3c2526d-9bf6-43c2-abda-787381c25449","Type":"ContainerStarted","Data":"4a9d1ec9db1300f1fcb643444226e88fd870adc53c8acefd96b239828d6e69da"} Jun 11 16:25:52.809616 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.809458 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"a3c2526d-9bf6-43c2-abda-787381c25449","Type":"ContainerStarted","Data":"557a85198bd1def101d86d01cb4b006d83654a4e8e03f8ea4bc679db4db9b26e"} Jun 11 16:25:52.828878 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:52.828812 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.489829399 podStartE2EDuration="1.828790839s" totalImagesPullingTime="338.96144ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:25:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:25:52.827202872 +0000 UTC m=+1019.481174662" watchObservedRunningTime="2026-06-11 16:25:52.828790839 +0000 UTC m=+1019.482762631" Jun 11 16:25:53.170738 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:53.170697 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 16:25:53.172984 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:53.172945 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:53.777198 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:53.777153 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16615002-26c6-43bb-b215-2db6146f281e" path="/var/lib/kubelet/pods/16615002-26c6-43bb-b215-2db6146f281e/volumes" Jun 11 16:25:54.171253 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:54.171130 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:55.170665 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:55.170621 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:56.170264 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:56.170205 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:57.170619 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:57.170557 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:58.171078 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:58.171026 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:25:59.171191 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:25:59.171135 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:00.170819 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:00.170762 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:01.170843 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:01.170794 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:02.170207 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:02.170156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:26:02.170457 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:02.170423 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:03.170461 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:03.170381 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:04.170820 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:04.170765 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:05.170292 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:05.170249 2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.39:9000/health/started\": dial tcp 10.133.0.39:9000: connect: connection refused" Jun 11 16:26:06.295374 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:06.295321 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 16:26:06.314361 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:06.314303 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:26:16.300734 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:16.300687 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="a3c2526d-9bf6-43c2-abda-787381c25449" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 16:26:26.301970 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:26.301936 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 16:26:37.036418 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.036306 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-758cb88984-p6mx6"] Jun 11 16:26:37.039878 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.039856 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.042849 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.042829 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 11 16:26:37.053324 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.053300 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-758cb88984-p6mx6"] Jun 11 16:26:37.102301 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.102265 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-oidc-ca\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.102491 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.102328 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-tls-cert\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.102491 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.102411 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdm7z\" (UniqueName: \"kubernetes.io/projected/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-kube-api-access-sdm7z\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.203031 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.202997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-tls-cert\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.203203 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.203068 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdm7z\" (UniqueName: \"kubernetes.io/projected/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-kube-api-access-sdm7z\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.203203 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.203115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-oidc-ca\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.203785 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.203760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-oidc-ca\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.205529 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.205507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-tls-cert\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.213302 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.213274 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdm7z\" (UniqueName: \"kubernetes.io/projected/96aa3869-a8cf-4549-88d2-f1a21ddd3e61-kube-api-access-sdm7z\") pod \"authorino-758cb88984-p6mx6\" (UID: \"96aa3869-a8cf-4549-88d2-f1a21ddd3e61\") " pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.349081 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.349001 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-758cb88984-p6mx6" Jun 11 16:26:37.492571 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:37.490926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-758cb88984-p6mx6"] Jun 11 16:26:37.496444 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:26:37.496408 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod96aa3869_a8cf_4549_88d2_f1a21ddd3e61.slice/crio-9ac894b32f83555256d4405ddd490521101e0b008d48767ca30ecea6c105a80f WatchSource:0}: Error finding container 9ac894b32f83555256d4405ddd490521101e0b008d48767ca30ecea6c105a80f: Status 404 returned error can't find the container with id 9ac894b32f83555256d4405ddd490521101e0b008d48767ca30ecea6c105a80f Jun 11 16:26:38.040577 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:38.040553 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-758cb88984-p6mx6" event={"ID":"96aa3869-a8cf-4549-88d2-f1a21ddd3e61","Type":"ContainerStarted","Data":"9ac894b32f83555256d4405ddd490521101e0b008d48767ca30ecea6c105a80f"} Jun 11 16:26:39.046530 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.046489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-758cb88984-p6mx6" event={"ID":"96aa3869-a8cf-4549-88d2-f1a21ddd3e61","Type":"ContainerStarted","Data":"d9665e9cd59ea6675be10b280595c055f7f0ca6da30d3fa52a2dbbeaf5125313"} Jun 11 16:26:39.065304 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.065254 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-758cb88984-p6mx6" podStartSLOduration=1.570875483 podStartE2EDuration="2.065237247s" totalImagesPullingTime="494.361764ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:26:39.063460459 +0000 UTC m=+1065.717432261" watchObservedRunningTime="2026-06-11 16:26:39.065237247 +0000 UTC m=+1065.719209038" Jun 11 16:26:39.095065 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.095030 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:26:39.095264 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.095239 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-64668f4678-bchks" podUID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" containerName="authorino" containerID="cri-o://1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428" gracePeriod=30 Jun 11 16:26:39.349567 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.349543 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:26:39.421748 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.421706 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tps9l\" (UniqueName: \"kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l\") pod \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " Jun 11 16:26:39.421937 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.421767 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert\") pod \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\" (UID: \"d0f1c782-287c-4cf8-89ad-a856e4580f0e\") " Jun 11 16:26:39.423839 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.423807 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l" (OuterVolumeSpecName: "kube-api-access-tps9l") pod "d0f1c782-287c-4cf8-89ad-a856e4580f0e" (UID: "d0f1c782-287c-4cf8-89ad-a856e4580f0e"). InnerVolumeSpecName "kube-api-access-tps9l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 16:26:39.431380 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.431353 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d0f1c782-287c-4cf8-89ad-a856e4580f0e" (UID: "d0f1c782-287c-4cf8-89ad-a856e4580f0e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 16:26:39.522795 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.522758 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tps9l\" (UniqueName: \"kubernetes.io/projected/d0f1c782-287c-4cf8-89ad-a856e4580f0e-kube-api-access-tps9l\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:26:39.522795 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.522786 2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d0f1c782-287c-4cf8-89ad-a856e4580f0e-tls-cert\") on node \"ip-10-0-138-8.ec2.internal\" DevicePath \"\"" Jun 11 16:26:39.807404 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.807352 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:26:39.945713 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:39.945682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:26:40.052367 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.052271 2562 generic.go:356] "Generic (PLEG): container finished" podID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" containerID="1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428" exitCode=0 Jun 11 16:26:40.052367 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.052316 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64668f4678-bchks" Jun 11 16:26:40.052367 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.052352 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64668f4678-bchks" event={"ID":"d0f1c782-287c-4cf8-89ad-a856e4580f0e","Type":"ContainerDied","Data":"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428"} Jun 11 16:26:40.052946 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.052410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64668f4678-bchks" event={"ID":"d0f1c782-287c-4cf8-89ad-a856e4580f0e","Type":"ContainerDied","Data":"51c6ec3947c4106899c6d726c4669d25fc1dead766633d831965478bbbe6316d"} Jun 11 16:26:40.052946 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.052430 2562 scope.go:117] "RemoveContainer" containerID="1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428" Jun 11 16:26:40.060651 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.060634 2562 scope.go:117] "RemoveContainer" containerID="1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428" Jun 11 16:26:40.060901 ip-10-0-138-8 kubenswrapper[2562]: E0611 16:26:40.060883 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428\": container with ID starting with 1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428 not found: ID does not exist" containerID="1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428" Jun 11 16:26:40.060960 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.060909 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428"} err="failed to get container status \"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428\": rpc error: code = NotFound desc = could not find container \"1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428\": container with ID starting with 1ccc6a1233bdb5edf554bc99514315e440de38365aba28f24b5e8cf09f829428 not found: ID does not exist" Jun 11 16:26:40.092919 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.092878 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:26:40.094359 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:40.094342 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-64668f4678-bchks"] Jun 11 16:26:41.775553 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:41.775519 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" path="/var/lib/kubelet/pods/d0f1c782-287c-4cf8-89ad-a856e4580f0e/volumes" Jun 11 16:26:45.553298 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:45.553250 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:26:50.876875 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:50.876839 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:26:50.954118 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:50.954083 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:26:51.185678 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:26:51.185580 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:03.643928 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:03.643894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:12.250895 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.250862 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf"] Jun 11 16:27:12.251272 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.251196 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" containerName="authorino" Jun 11 16:27:12.251272 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.251207 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" containerName="authorino" Jun 11 16:27:12.251272 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.251267 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0f1c782-287c-4cf8-89ad-a856e4580f0e" containerName="authorino" Jun 11 16:27:12.254298 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.254283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.257696 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.257668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 16:27:12.257836 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.257719 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 11 16:27:12.257836 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.257762 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-26ghs\"" Jun 11 16:27:12.257836 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.257769 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 16:27:12.273778 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.273747 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf"] Jun 11 16:27:12.317680 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.317642 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:12.412018 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.411976 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.412018 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.412019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.412235 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.412044 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.412235 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.412089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5x4v\" (UniqueName: \"kubernetes.io/projected/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kube-api-access-h5x4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.412235 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.412154 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.412235 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.412210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513554 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513461 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513554 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513554 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513847 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513570 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513847 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513593 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.513847 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5x4v\" (UniqueName: \"kubernetes.io/projected/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kube-api-access-h5x4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.514013 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.514013 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.513965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.514096 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.514039 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.515866 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.515843 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.516168 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.516149 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.522140 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.522114 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5x4v\" (UniqueName: \"kubernetes.io/projected/e5b1c07e-bf09-4f26-ac25-0e872e1a3097-kube-api-access-h5x4v\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf\" (UID: \"e5b1c07e-bf09-4f26-ac25-0e872e1a3097\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.565110 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.565073 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:27:12.707633 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:12.707594 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf"] Jun 11 16:27:12.710998 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:27:12.710968 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b1c07e_bf09_4f26_ac25_0e872e1a3097.slice/crio-f768b7dac2cd137eefe1ffda9b88734bbe38eae4f2ada104fa57bfe7356ac300 WatchSource:0}: Error finding container f768b7dac2cd137eefe1ffda9b88734bbe38eae4f2ada104fa57bfe7356ac300: Status 404 returned error can't find the container with id f768b7dac2cd137eefe1ffda9b88734bbe38eae4f2ada104fa57bfe7356ac300 Jun 11 16:27:13.201824 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:13.201789 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" event={"ID":"e5b1c07e-bf09-4f26-ac25-0e872e1a3097","Type":"ContainerStarted","Data":"f768b7dac2cd137eefe1ffda9b88734bbe38eae4f2ada104fa57bfe7356ac300"} Jun 11 16:27:17.224185 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:17.224149 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" event={"ID":"e5b1c07e-bf09-4f26-ac25-0e872e1a3097","Type":"ContainerStarted","Data":"d980d25582cd19c72bf2d9a59c275ba847d276fc623d423030fec86e324d0769"} Jun 11 16:27:17.330647 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:17.330608 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:24.690874 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:24.690820 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:38.318758 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:38.318718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:59.661554 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:59.661512 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:27:59.762325 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:27:59.762288 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:28:00.725715 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:00.725683 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:28:11.481152 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:11.481047 2562 generic.go:356] "Generic (PLEG): container finished" podID="e5b1c07e-bf09-4f26-ac25-0e872e1a3097" containerID="d980d25582cd19c72bf2d9a59c275ba847d276fc623d423030fec86e324d0769" exitCode=0 Jun 11 16:28:11.481152 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:11.481120 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" event={"ID":"e5b1c07e-bf09-4f26-ac25-0e872e1a3097","Type":"ContainerDied","Data":"d980d25582cd19c72bf2d9a59c275ba847d276fc623d423030fec86e324d0769"} Jun 11 16:28:13.492595 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:13.492562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" event={"ID":"e5b1c07e-bf09-4f26-ac25-0e872e1a3097","Type":"ContainerStarted","Data":"6933bd3e026b8d7aad2afb54777e585e0fedfdd57590bf5e441caace7d1df2ee"} Jun 11 16:28:13.514153 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:13.514102 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" podStartSLOduration=2.183664627 podStartE2EDuration="1m1.514087255s" totalImagesPullingTime="4.963512316s" totalInitContainerRuntime="54.366910312s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:27:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:28:13.512825489 +0000 UTC m=+1160.166797298" watchObservedRunningTime="2026-06-11 16:28:13.514087255 +0000 UTC m=+1160.168059046" Jun 11 16:28:22.565296 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:22.565257 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:28:22.565733 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:22.565328 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:28:22.577894 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:22.577869 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:28:23.547195 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:23.547165 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf" Jun 11 16:28:28.019254 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:28.019220 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:28:53.803884 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:53.803857 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:28:53.806552 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:28:53.804593 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:33:20.818936 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:20.818886 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-758cb88984-p6mx6_96aa3869-a8cf-4549-88d2-f1a21ddd3e61/authorino/0.log" Jun 11 16:33:25.539931 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:25.539902 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-758d6cf95f-pnzxq_6a50b8fb-104b-4130-957f-b7cb3d174427/nginx/0.log" Jun 11 16:33:25.880948 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:25.880865 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8499f7f9d-pwjvq_911a514c-3ac1-4fbc-ad49-7ccc3c553dba/maas-api/0.log" Jun 11 16:33:26.554610 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:26.554580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb875574b-6gwkd_92acf591-b64d-4a5b-983f-9edc9f3771c5/copy-manifests/0.log" Jun 11 16:33:26.572997 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:26.572967 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb875574b-6gwkd_92acf591-b64d-4a5b-983f-9edc9f3771c5/manager/0.log" Jun 11 16:33:28.064260 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:28.064228 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-758cb88984-p6mx6_96aa3869-a8cf-4549-88d2-f1a21ddd3e61/authorino/0.log" Jun 11 16:33:28.181224 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:28.181185 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jsmsh_2bdf36ae-3f9c-43a0-81fc-4e305ef3f278/manager/0.log" Jun 11 16:33:28.510691 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:28.510654 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4jhzq_d3703acc-7d5f-4279-823b-55666e7e0479/registry-server/0.log" Jun 11 16:33:28.632645 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:28.632615 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5wl2t_371b2888-b90c-41b3-a801-ee1e91ed5ece/manager/0.log" Jun 11 16:33:29.199111 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:29.199079 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk_c9a66154-0e29-4baa-9d10-25ef6b6c05c8/istio-proxy/0.log" Jun 11 16:33:29.639006 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:29.638973 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/1.log" Jun 11 16:33:29.750801 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:29.750769 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vp8cd_035334ac-7213-47c1-8573-81d075b891a6/payload-pre-processing/0.log" Jun 11 16:33:30.637945 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:30.637907 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf_e5b1c07e-bf09-4f26-ac25-0e872e1a3097/storage-initializer/0.log" Jun 11 16:33:30.644897 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:30.644873 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477cjvnnf_e5b1c07e-bf09-4f26-ac25-0e872e1a3097/main/0.log" Jun 11 16:33:34.847101 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.847067 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvx9r/must-gather-nbgml"] Jun 11 16:33:34.850511 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.850491 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:34.852782 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.852757 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvx9r\"/\"openshift-service-ca.crt\"" Jun 11 16:33:34.853143 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.853125 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-fvx9r\"/\"default-dockercfg-xmzhk\"" Jun 11 16:33:34.853220 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.853170 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-fvx9r\"/\"kube-root-ca.crt\"" Jun 11 16:33:34.884537 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.884507 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvx9r/must-gather-nbgml"] Jun 11 16:33:34.978562 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.978532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr48f\" (UniqueName: \"kubernetes.io/projected/2dcbecc1-8e96-4a8d-b8db-c337553a664b-kube-api-access-dr48f\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:34.978751 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:34.978584 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dcbecc1-8e96-4a8d-b8db-c337553a664b-must-gather-output\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.079490 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.079450 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr48f\" (UniqueName: \"kubernetes.io/projected/2dcbecc1-8e96-4a8d-b8db-c337553a664b-kube-api-access-dr48f\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.079709 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.079532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dcbecc1-8e96-4a8d-b8db-c337553a664b-must-gather-output\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.079873 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.079853 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2dcbecc1-8e96-4a8d-b8db-c337553a664b-must-gather-output\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.088070 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.088045 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr48f\" (UniqueName: \"kubernetes.io/projected/2dcbecc1-8e96-4a8d-b8db-c337553a664b-kube-api-access-dr48f\") pod \"must-gather-nbgml\" (UID: \"2dcbecc1-8e96-4a8d-b8db-c337553a664b\") " pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.159288 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.159188 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvx9r/must-gather-nbgml" Jun 11 16:33:35.297987 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.297960 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvx9r/must-gather-nbgml"] Jun 11 16:33:35.300648 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:33:35.300616 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dcbecc1_8e96_4a8d_b8db_c337553a664b.slice/crio-3d0229e5e5d895f2c30ea0be1576c33bf499c65cc0667b77e6b101d5f8819d69 WatchSource:0}: Error finding container 3d0229e5e5d895f2c30ea0be1576c33bf499c65cc0667b77e6b101d5f8819d69: Status 404 returned error can't find the container with id 3d0229e5e5d895f2c30ea0be1576c33bf499c65cc0667b77e6b101d5f8819d69 Jun 11 16:33:35.302580 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.302563 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 16:33:35.605128 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.605090 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:33:35.947780 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:35.947660 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvx9r/must-gather-nbgml" event={"ID":"2dcbecc1-8e96-4a8d-b8db-c337553a664b","Type":"ContainerStarted","Data":"3d0229e5e5d895f2c30ea0be1576c33bf499c65cc0667b77e6b101d5f8819d69"} Jun 11 16:33:36.617659 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:36.617540 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" limit=1024 Jun 11 16:33:36.955655 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:36.955547 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvx9r/must-gather-nbgml" event={"ID":"2dcbecc1-8e96-4a8d-b8db-c337553a664b","Type":"ContainerStarted","Data":"c72954596e0aed4cc8638d68271ad705ec1d0fa1495bbd62af925355630bdbd9"} Jun 11 16:33:36.956230 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:36.956177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvx9r/must-gather-nbgml" event={"ID":"2dcbecc1-8e96-4a8d-b8db-c337553a664b","Type":"ContainerStarted","Data":"898ccf6591b3b826f00df01c1b3fed4f074853126f1cdc54a30a4367f9aad0fe"} Jun 11 16:33:36.973507 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:36.973455 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fvx9r/must-gather-nbgml" podStartSLOduration=2.211033334 podStartE2EDuration="2.973441123s" totalImagesPullingTime="762.407789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 16:33:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:33:36.971604037 +0000 UTC m=+1483.625575818" watchObservedRunningTime="2026-06-11 16:33:36.973441123 +0000 UTC m=+1483.627412912" Jun 11 16:33:37.759368 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:37.759338 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qvvst_1742c73f-8da9-4431-aa49-3f9f053a1d05/global-pull-secret-syncer/0.log" Jun 11 16:33:37.896613 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:37.896580 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-krdfw_76e343fd-6f32-49ed-96c2-c0ce6cb85a82/konnectivity-agent/0.log" Jun 11 16:33:38.002985 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:38.002945 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-8.ec2.internal_b3963a799e27f3367f2e8f417ee82df7/haproxy/0.log" Jun 11 16:33:42.703983 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:42.703913 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-758cb88984-p6mx6_96aa3869-a8cf-4549-88d2-f1a21ddd3e61/authorino/0.log" Jun 11 16:33:42.735663 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:42.735630 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-jsmsh_2bdf36ae-3f9c-43a0-81fc-4e305ef3f278/manager/0.log" Jun 11 16:33:42.859115 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:42.859076 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4jhzq_d3703acc-7d5f-4279-823b-55666e7e0479/registry-server/0.log" Jun 11 16:33:42.907755 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:42.907724 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-5wl2t_371b2888-b90c-41b3-a801-ee1e91ed5ece/manager/0.log" Jun 11 16:33:44.944420 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:44.943948 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-78b865899-vf4ml_4f3e6b0c-85ad-4179-89f7-dd6f1b143614/metrics-server/0.log" Jun 11 16:33:45.099916 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.099831 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxq77_43d68a21-c22b-4950-8f0c-82ee1187b5d2/node-exporter/0.log" Jun 11 16:33:45.129441 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.129417 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxq77_43d68a21-c22b-4950-8f0c-82ee1187b5d2/kube-rbac-proxy/0.log" Jun 11 16:33:45.163985 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.163940 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bxq77_43d68a21-c22b-4950-8f0c-82ee1187b5d2/init-textfile/0.log" Jun 11 16:33:45.287023 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.286985 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-djg4m_66b1f79d-7c4e-4663-be54-477b672cd8b0/kube-rbac-proxy-main/0.log" Jun 11 16:33:45.316360 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.316323 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-djg4m_66b1f79d-7c4e-4663-be54-477b672cd8b0/kube-rbac-proxy-self/0.log" Jun 11 16:33:45.339840 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.339808 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-djg4m_66b1f79d-7c4e-4663-be54-477b672cd8b0/openshift-state-metrics/0.log" Jun 11 16:33:45.606997 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:45.606965 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-fql67_62d896e2-9b1f-4237-8b07-68bd96709935/prometheus-operator-admission-webhook/0.log" Jun 11 16:33:48.211111 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.211060 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2"] Jun 11 16:33:48.218343 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.218314 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.224495 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.224462 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2"] Jun 11 16:33:48.314123 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.314070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-lib-modules\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.314313 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.314128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wckr6\" (UniqueName: \"kubernetes.io/projected/a40e317b-13fc-4815-99a1-4d7c05889f8a-kube-api-access-wckr6\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.314313 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.314171 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-proc\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.314313 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.314239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-sys\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.314313 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.314292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-podres\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415289 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415247 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-sys\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415498 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415321 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-podres\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415498 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415376 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-lib-modules\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415498 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415416 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-sys\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415498 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wckr6\" (UniqueName: \"kubernetes.io/projected/a40e317b-13fc-4815-99a1-4d7c05889f8a-kube-api-access-wckr6\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-podres\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-proc\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415739 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415713 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-proc\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.415894 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.415749 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a40e317b-13fc-4815-99a1-4d7c05889f8a-lib-modules\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.424795 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.424769 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wckr6\" (UniqueName: \"kubernetes.io/projected/a40e317b-13fc-4815-99a1-4d7c05889f8a-kube-api-access-wckr6\") pod \"perf-node-gather-daemonset-bxxq2\" (UID: \"a40e317b-13fc-4815-99a1-4d7c05889f8a\") " pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.510482 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.510447 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5977456657-cwwcm_973a6cd5-9771-476b-ab46-a22d298efd8d/console/0.log" Jun 11 16:33:48.544196 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.544164 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:48.752002 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:48.751974 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2"] Jun 11 16:33:48.753959 ip-10-0-138-8 kubenswrapper[2562]: W0611 16:33:48.753929 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda40e317b_13fc_4815_99a1_4d7c05889f8a.slice/crio-dcc4aa6efb4bd0149ac8e2fe53f14c8fe7ee443a21f31e40114bcc228379518a WatchSource:0}: Error finding container dcc4aa6efb4bd0149ac8e2fe53f14c8fe7ee443a21f31e40114bcc228379518a: Status 404 returned error can't find the container with id dcc4aa6efb4bd0149ac8e2fe53f14c8fe7ee443a21f31e40114bcc228379518a Jun 11 16:33:49.036471 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:49.036358 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" event={"ID":"a40e317b-13fc-4815-99a1-4d7c05889f8a","Type":"ContainerStarted","Data":"b81eefb7b90ae1d65b1a3c8b3cb2d9774c096c681e4520554412a0c43d1799da"} Jun 11 16:33:49.036471 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:49.036437 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" event={"ID":"a40e317b-13fc-4815-99a1-4d7c05889f8a","Type":"ContainerStarted","Data":"dcc4aa6efb4bd0149ac8e2fe53f14c8fe7ee443a21f31e40114bcc228379518a"} Jun 11 16:33:49.036471 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:49.036468 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:49.054303 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:49.054228 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" podStartSLOduration=1.054206503 podStartE2EDuration="1.054206503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 16:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 16:33:49.053651861 +0000 UTC m=+1495.707623662" watchObservedRunningTime="2026-06-11 16:33:49.054206503 +0000 UTC m=+1495.708178294" Jun 11 16:33:50.482756 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:50.482707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7bpl8_8bf0f773-9b7a-4510-91ed-1b55d35984a3/dns/0.log" Jun 11 16:33:50.505128 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:50.505093 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7bpl8_8bf0f773-9b7a-4510-91ed-1b55d35984a3/kube-rbac-proxy/0.log" Jun 11 16:33:50.690036 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:50.690007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ntgfl_2763331e-e015-4d97-a700-f8333064921e/dns-node-resolver/0.log" Jun 11 16:33:51.300972 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:51.300941 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7msjq_70bd67a7-9c07-4bbc-a261-8da7f252bc91/node-ca/0.log" Jun 11 16:33:52.382920 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:52.382887 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk_c9a66154-0e29-4baa-9d10-25ef6b6c05c8/istio-proxy/0.log" Jun 11 16:33:52.506237 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:52.506203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/1.log" Jun 11 16:33:52.507073 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:52.507049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/0.log" Jun 11 16:33:52.527599 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:52.527573 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vp8cd_035334ac-7213-47c1-8573-81d075b891a6/payload-pre-processing/0.log" Jun 11 16:33:53.284336 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:53.284304 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pt97z_c9544e6f-e857-401e-b430-b5433824da97/serve-healthcheck-canary/0.log" Jun 11 16:33:53.847281 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:53.847136 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:33:53.863871 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:53.847644 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wp94_7b8489e1-f957-4181-b952-1f28e581006c/ovn-acl-logging/0.log" Jun 11 16:33:53.972216 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:53.972189 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqtvf_d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c/kube-rbac-proxy/0.log" Jun 11 16:33:53.995045 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:53.995010 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqtvf_d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c/exporter/0.log" Jun 11 16:33:54.018898 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:54.018867 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pqtvf_d9aa9b93-5892-4f3c-99d8-11f5a6fc8d3c/extractor/0.log" Jun 11 16:33:55.054348 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:55.054309 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-fvx9r/perf-node-gather-daemonset-bxxq2" Jun 11 16:33:56.485596 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:56.485562 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-758d6cf95f-pnzxq_6a50b8fb-104b-4130-957f-b7cb3d174427/nginx/0.log" Jun 11 16:33:56.582322 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:56.582258 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8499f7f9d-pwjvq_911a514c-3ac1-4fbc-ad49-7ccc3c553dba/maas-api/0.log" Jun 11 16:33:56.892482 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:56.892436 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb875574b-6gwkd_92acf591-b64d-4a5b-983f-9edc9f3771c5/manager/0.log" Jun 11 16:33:56.918926 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:56.918891 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-fb875574b-6gwkd_92acf591-b64d-4a5b-983f-9edc9f3771c5/copy-manifests/0.log" Jun 11 16:33:58.849932 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:33:58.849849 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67c4b4c7b5-kcnb8_9b54c091-0698-4312-9280-dcefee235946/manager/0.log" Jun 11 16:34:02.872199 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:02.872164 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk_c9a66154-0e29-4baa-9d10-25ef6b6c05c8/istio-proxy/0.log" Jun 11 16:34:02.949746 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:02.949713 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/1.log" Jun 11 16:34:02.950432 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:02.950407 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/0.log" Jun 11 16:34:02.965157 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:02.965129 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vp8cd_035334ac-7213-47c1-8573-81d075b891a6/payload-pre-processing/0.log" Jun 11 16:34:04.156966 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:04.156930 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6f4bb8994cb7wzk_c9a66154-0e29-4baa-9d10-25ef6b6c05c8/istio-proxy/0.log" Jun 11 16:34:04.242134 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:04.242104 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/1.log" Jun 11 16:34:04.242579 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:04.242561 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-67497754f6-6wjkz_a82691bd-3e22-4a0d-85cf-53e15f7316ec/istio-proxy/0.log" Jun 11 16:34:04.255202 ip-10-0-138-8 kubenswrapper[2562]: I0611 16:34:04.255173 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-vp8cd_035334ac-7213-47c1-8573-81d075b891a6/payload-pre-processing/0.log"