Jun 07 19:47:55.928366 ip-10-0-139-107 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 07 19:47:55.928511 ip-10-0-139-107 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 07 19:47:55.928608 ip-10-0-139-107 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 07 19:47:55.928875 ip-10-0-139-107 systemd[1]: Failed to start Kubernetes Kubelet. Jun 07 19:48:06.140846 ip-10-0-139-107 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 07 19:48:06.140865 ip-10-0-139-107 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 220e3b41bdc348d7923dfd1dfa349624 -- Jun 07 19:50:30.281490 ip-10-0-139-107 systemd[1]: Starting Kubernetes Kubelet... Jun 07 19:50:30.769170 ip-10-0-139-107 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:50:30.769170 ip-10-0-139-107 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 07 19:50:30.769170 ip-10-0-139-107 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:50:30.769170 ip-10-0-139-107 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 07 19:50:30.769170 ip-10-0-139-107 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 07 19:50:30.770253 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.770171 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 07 19:50:30.775421 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775407 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.775421 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775421 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775424 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775428 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775431 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775434 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775437 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775439 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775443 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775445 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775448 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775451 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775453 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775464 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775466 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775469 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775471 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775474 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775476 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775479 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775481 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.775488 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775483 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775486 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775489 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775491 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775494 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775497 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775500 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775502 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775505 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775507 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775509 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775512 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775514 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775517 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775519 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775522 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775524 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775527 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775530 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775532 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.775936 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775534 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775537 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775540 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775542 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775545 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775547 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775549 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775552 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775554 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775557 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775559 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775561 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775564 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775567 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775570 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775573 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775576 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775579 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775582 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775584 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.776417 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775586 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775589 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775592 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775594 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775598 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775601 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775604 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775607 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775609 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775612 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775616 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775619 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775621 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775624 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775626 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775629 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775631 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775636 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.776880 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775640 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775644 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775647 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775650 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775653 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775655 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775658 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775661 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775664 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775667 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775669 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775672 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775674 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775677 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775680 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775682 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775685 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775687 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775690 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.775693 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.777312 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776351 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776357 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776361 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776364 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776367 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776370 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776372 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776375 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776377 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776380 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776382 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776386 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776391 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776394 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776397 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776400 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776403 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776406 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776409 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.777843 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776412 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776415 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776418 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776421 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776424 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776428 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776430 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776433 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776436 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776439 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776442 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776446 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776449 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776452 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776455 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776457 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776460 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776463 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776465 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.778341 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776468 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776471 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776473 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776476 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776479 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776484 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776487 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776489 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776492 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776495 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776497 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776499 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776502 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776505 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776507 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776510 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776512 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776515 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776518 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776520 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.778796 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776523 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776525 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776528 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776530 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776533 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776535 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776537 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776540 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776542 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776545 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776547 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776550 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776552 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776555 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776558 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776560 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776563 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776566 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776569 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776571 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.779300 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776574 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776576 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776579 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776581 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776584 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776586 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776589 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776591 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776594 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776596 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776598 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776601 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776603 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776605 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776608 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776610 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776613 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776615 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776618 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776620 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.779767 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.776623 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777015 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777020 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777023 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777026 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777031 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777034 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777037 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777040 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777043 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777046 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777050 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777053 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777056 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777059 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777062 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777065 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777068 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777070 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.780249 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777073 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777076 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777078 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777081 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777083 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777086 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777089 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777091 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777094 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777096 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777098 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777101 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777104 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777107 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777109 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777112 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777114 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777117 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777119 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777126 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.780686 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777128 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777131 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777134 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777136 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777153 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777156 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777159 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777161 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777164 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777168 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777171 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777174 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777176 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777179 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777181 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777183 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777186 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777188 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777191 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777193 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.781164 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777195 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777200 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777202 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777205 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777208 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777210 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777213 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777215 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777218 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777220 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777223 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777225 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777228 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777230 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777233 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777236 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777238 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777240 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777243 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777245 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.781648 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777248 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777250 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777253 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777255 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777257 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777260 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777262 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777264 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777267 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777269 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777272 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777274 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777277 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777284 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777286 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777289 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777292 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777294 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777296 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777299 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.782216 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777302 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777364 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777370 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777376 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777380 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777384 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777391 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777395 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777399 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777402 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777405 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777408 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777411 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777414 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777417 2576 flags.go:64] FLAG: --cgroup-root="" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777419 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777422 2576 flags.go:64] FLAG: --client-ca-file="" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777425 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777428 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777431 2576 flags.go:64] FLAG: --cluster-domain="" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777434 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777437 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777440 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777443 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 07 19:50:30.782710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777447 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777450 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777453 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777456 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777459 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777462 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777464 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777468 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777470 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777474 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777477 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777480 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777483 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777486 2576 flags.go:64] FLAG: --enable-server="true" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777490 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777494 2576 flags.go:64] FLAG: --event-burst="100" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777497 2576 flags.go:64] FLAG: --event-qps="50" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777500 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777503 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777506 2576 flags.go:64] FLAG: --eviction-hard="" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777509 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777512 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777515 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777517 2576 flags.go:64] FLAG: --eviction-soft="" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777520 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 07 19:50:30.783319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777523 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777526 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777528 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777531 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777534 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777536 2576 flags.go:64] FLAG: --feature-gates="" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777540 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777543 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777547 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777550 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777553 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777556 2576 flags.go:64] FLAG: --help="false" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777558 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-107.ec2.internal" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777561 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777564 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777567 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777570 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777573 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777576 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777579 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777581 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777586 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777589 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777592 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 07 19:50:30.783912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777594 2576 flags.go:64] FLAG: --kube-reserved="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777597 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777600 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777602 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777605 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777608 2576 flags.go:64] FLAG: --lock-file="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777611 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777613 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777616 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777629 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777632 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777635 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777638 2576 flags.go:64] FLAG: --logging-format="text" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777640 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777643 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777679 2576 flags.go:64] FLAG: --manifest-url="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777685 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777690 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777693 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777697 2576 flags.go:64] FLAG: --max-pods="110" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777700 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777703 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777706 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777709 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777712 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 07 19:50:30.784489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777715 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777718 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777724 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777727 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777732 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777734 2576 flags.go:64] FLAG: --pod-cidr="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777738 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777743 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777746 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777749 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777752 2576 flags.go:64] FLAG: --port="10250" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777755 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777758 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-038fbc9ce894db441" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777761 2576 flags.go:64] FLAG: --qos-reserved="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777764 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777767 2576 flags.go:64] FLAG: --register-node="true" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777770 2576 flags.go:64] FLAG: --register-with-taints="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777774 2576 flags.go:64] FLAG: --registry-burst="10" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777777 2576 flags.go:64] FLAG: --registry-qps="5" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777780 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777782 2576 flags.go:64] FLAG: --reserved-memory="" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777786 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777789 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777793 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777796 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 07 19:50:30.785072 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777799 2576 flags.go:64] FLAG: --runonce="false" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777801 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777805 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777807 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777810 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777813 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777816 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777819 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777822 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777825 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777828 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777831 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777836 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777839 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777842 2576 flags.go:64] FLAG: --system-cgroups="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777845 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777850 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777853 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777856 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777860 2576 flags.go:64] FLAG: --tls-min-version="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777863 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777865 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777868 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777871 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777874 2576 flags.go:64] FLAG: --v="2" Jun 07 19:50:30.785746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777877 2576 flags.go:64] FLAG: --version="false" Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777881 2576 flags.go:64] FLAG: --vmodule="" Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777885 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.777888 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777993 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.777997 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778001 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778005 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778009 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778012 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778015 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778017 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778020 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778023 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778025 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778028 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778030 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778033 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778036 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778039 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778042 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.786380 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778045 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778048 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778051 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778054 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778056 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778059 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778061 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778064 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778067 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778069 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778072 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778075 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778077 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778080 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778082 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778085 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778087 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778090 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778092 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.786898 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778095 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778097 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778100 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778102 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778105 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778107 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778110 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778112 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778115 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778117 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778120 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778124 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778126 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778129 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778131 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778151 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778154 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778156 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778159 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778162 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.787437 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778165 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778167 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778170 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778173 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778176 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778178 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778181 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778184 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778186 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778189 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778191 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778194 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778197 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778200 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778202 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778205 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778207 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778210 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778213 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.788026 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778215 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778218 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778220 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778223 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778226 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778229 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778232 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778235 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778237 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778246 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778249 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778251 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778254 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778258 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778261 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778264 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778267 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778270 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778273 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.788492 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778276 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778278 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778281 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778283 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.778287 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.778301 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.785472 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.785576 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.785593 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.785603 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785689 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785695 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785698 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785702 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.788932 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785705 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785708 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785710 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785713 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785716 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785719 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785722 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785724 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785727 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785729 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785732 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785734 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785737 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785739 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785742 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785744 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785747 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785750 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785752 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785755 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.789317 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785758 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785760 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785763 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785766 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785768 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785778 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785781 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785785 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785788 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785792 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785795 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785798 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785801 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785803 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785806 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785809 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785812 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785815 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785818 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785821 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.789872 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785824 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785826 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785829 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785832 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785834 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785837 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785839 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785842 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785845 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785847 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785850 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785852 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785855 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785857 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785860 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785863 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785866 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785869 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785877 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.790379 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785880 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785883 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785886 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785888 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785891 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785895 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785898 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785901 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785904 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785906 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785909 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785912 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785915 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785917 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785920 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785923 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785925 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785928 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785930 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785933 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.790844 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785935 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785938 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785941 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785943 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785946 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785948 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785951 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785953 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785956 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785959 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785962 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785965 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785973 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785976 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785980 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.791372 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.785983 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.785988 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786136 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786154 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786158 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786161 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786164 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786166 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786169 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786171 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786174 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786177 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786179 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786182 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786184 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786187 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 07 19:50:30.791729 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786190 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786193 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786195 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786198 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786200 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786203 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786205 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786208 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786211 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786213 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786216 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786219 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786222 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786225 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786233 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786236 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786238 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786241 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786244 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786246 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 07 19:50:30.792109 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786249 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786251 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786254 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786256 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786259 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786261 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786264 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786266 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786269 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786271 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786274 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786276 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786279 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786282 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786286 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786290 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786292 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786295 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786298 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 07 19:50:30.792584 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786300 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786303 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786305 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786308 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786311 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786314 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786316 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786319 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786328 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786330 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786333 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786335 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786338 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786340 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786343 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786345 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786348 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786352 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786354 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 07 19:50:30.793024 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786357 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786359 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786361 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786364 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786366 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786369 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786371 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786373 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786376 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786384 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786387 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786390 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786393 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786395 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786398 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786400 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786404 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786407 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786410 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 07 19:50:30.793494 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786413 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786416 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786419 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786427 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786429 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786432 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786434 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:30.786436 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.786441 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.786548 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.791843 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.793380 2576 server.go:1019] "Starting client certificate rotation" Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.793475 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 19:50:30.793958 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.793511 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 07 19:50:30.796071 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.796058 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 19:50:30.798547 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.798520 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 07 19:50:30.809808 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.809787 2576 log.go:25] "Validated CRI v1 runtime API" Jun 07 19:50:30.813157 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.813132 2576 log.go:25] "Validated CRI v1 image API" Jun 07 19:50:30.813879 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.813865 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 07 19:50:30.816458 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.816440 2576 fs.go:135] Filesystem UUIDs: map[010c2251-635c-4057-aebb-a4fec7998b86:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a2d19b31-214b-41d5-8533-d50e5ef980b2:/dev/nvme0n1p4] Jun 07 19:50:30.816514 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.816458 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 07 19:50:30.820303 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.820285 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 19:50:30.822099 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.821978 2576 manager.go:216] Machine: {Timestamp:2026-06-07 19:50:30.820568075 +0000 UTC m=+0.403083345 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138928 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a103262c1d29d53bd6c3724d07aec SystemUUID:ec2a1032-62c1-d29d-53bd-6c3724d07aec BootID:220e3b41-bdc3-48d7-923d-fd1dfa349624 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4e:be:b1:40:4d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4e:be:b1:40:4d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:f3:f6:ed:85:ec Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 07 19:50:30.822099 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.822077 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 07 19:50:30.822254 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.822191 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 07 19:50:30.825423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.825402 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 07 19:50:30.825553 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.825426 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-107.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 07 19:50:30.826279 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.826269 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 07 19:50:30.826613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.826589 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 07 19:50:30.826760 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.826742 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 19:50:30.826835 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.826787 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 07 19:50:30.828026 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.828011 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 07 19:50:30.832358 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832346 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 07 19:50:30.832461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832452 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 07 19:50:30.832489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832482 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 07 19:50:30.832524 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832493 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 07 19:50:30.832524 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832506 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 07 19:50:30.832524 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832515 2576 kubelet.go:398] "Adding apiserver pod source" Jun 07 19:50:30.832524 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832523 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 07 19:50:30.832848 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832831 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 19:50:30.832848 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.832854 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 07 19:50:30.836713 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.836695 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 07 19:50:30.839240 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.839225 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 07 19:50:30.839327 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.839262 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 07 19:50:30.840182 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.840151 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 07 19:50:30.840316 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.840291 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 07 19:50:30.840751 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840738 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 07 19:50:30.840793 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840760 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 07 19:50:30.840793 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840770 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 07 19:50:30.840793 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840778 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 07 19:50:30.840793 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840791 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840799 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840809 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840817 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840826 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840834 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840846 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 07 19:50:30.840897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.840867 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 07 19:50:30.841730 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.841719 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 07 19:50:30.841730 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.841731 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 07 19:50:30.842097 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.842078 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5m47f" Jun 07 19:50:30.844199 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.844186 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-107.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 07 19:50:30.844681 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.844662 2576 server.go:1268] "Started kubelet" Jun 07 19:50:30.844779 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.844712 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 07 19:50:30.844846 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.844788 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 07 19:50:30.844965 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.844949 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 07 19:50:30.845438 ip-10-0-139-107 systemd[1]: Started Kubernetes Kubelet. Jun 07 19:50:30.847013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.846998 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 07 19:50:30.847162 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.847120 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 07 19:50:30.852040 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.852021 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5m47f" Jun 07 19:50:30.852809 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.852793 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 07 19:50:30.856955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.856939 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 07 19:50:30.857037 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.856943 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 07 19:50:30.857079 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.857041 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:30.857366 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.856190 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-107.ec2.internal.18b6e466558b93a2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-107.ec2.internal,UID:ip-10-0-139-107.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-107.ec2.internal,},FirstTimestamp:2026-06-07 19:50:30.844617634 +0000 UTC m=+0.427132906,LastTimestamp:2026-06-07 19:50:30.844617634 +0000 UTC m=+0.427132906,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-107.ec2.internal,}" Jun 07 19:50:30.857718 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.857673 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 07 19:50:30.857806 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.857692 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 07 19:50:30.857806 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.857750 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 07 19:50:30.857912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.857897 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 07 19:50:30.857912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.857909 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 07 19:50:30.858511 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858492 2576 factory.go:55] Registering systemd factory Jun 07 19:50:30.858511 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858513 2576 factory.go:223] Registration of the systemd container factory successfully Jun 07 19:50:30.858745 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858720 2576 factory.go:153] Registering CRI-O factory Jun 07 19:50:30.858745 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858739 2576 factory.go:223] Registration of the crio container factory successfully Jun 07 19:50:30.858872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858786 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 07 19:50:30.858872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858810 2576 factory.go:103] Registering Raw factory Jun 07 19:50:30.858872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.858825 2576 manager.go:1196] Started watching for new ooms in manager Jun 07 19:50:30.859249 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.859227 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 07 19:50:30.859397 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.859384 2576 manager.go:349] Starting recovery of all containers Jun 07 19:50:30.859471 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.859378 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-107.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 07 19:50:30.869292 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.869277 2576 manager.go:354] Recovery completed Jun 07 19:50:30.873134 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.873123 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:30.874753 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.874738 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:30.874817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.874765 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:30.874817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.874777 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:30.875305 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.875291 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 07 19:50:30.875305 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.875303 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 07 19:50:30.875381 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.875317 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 07 19:50:30.875450 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.875438 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:30.876033 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.876013 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:30.876103 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.876048 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:30.876103 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.876061 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:30.877320 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.877307 2576 policy_none.go:49] "None policy: Start" Jun 07 19:50:30.877356 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.877326 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 07 19:50:30.877356 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.877340 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 07 19:50:30.879196 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.879185 2576 policy_none.go:47] "Start" Jun 07 19:50:30.914718 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.914702 2576 manager.go:337] "Starting Device Plugin manager" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.914749 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.914758 2576 server.go:87] "Starting device plugin registration server" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.914986 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.914998 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.915072 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.915155 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.915164 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.916569 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.916603 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.927287 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.928370 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.928401 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.928419 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:30.928469 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 07 19:50:30.939981 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:30.930277 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:50:31.015200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.015181 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:31.016527 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.016513 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:31.016612 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.016544 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:31.016612 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.016557 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:31.016612 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.016582 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.022711 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.022696 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.022775 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.022715 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-107.ec2.internal\": node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.029372 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.029356 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal"] Jun 07 19:50:31.029458 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.029408 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:31.031084 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.031068 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:31.031166 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.031088 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:31.031166 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.031097 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:31.033417 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.033403 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.033460 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.033422 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:31.033553 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.033543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.033593 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.033565 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:31.034038 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034026 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:31.034076 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034051 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:31.034076 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034063 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:31.034160 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034052 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:31.034200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034179 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:31.034200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.034191 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:31.036668 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.036656 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.036700 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.036679 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 07 19:50:31.037260 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.037246 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientMemory" Jun 07 19:50:31.037320 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.037272 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasNoDiskPressure" Jun 07 19:50:31.037320 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.037288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeHasSufficientPID" Jun 07 19:50:31.049735 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.049717 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-107.ec2.internal\" not found" node="ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.053466 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.053450 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-107.ec2.internal\" not found" node="ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.058979 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.058964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.059032 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.058986 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.059032 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.059008 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315bddd24f7efc22924c6fa01e51e8cc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-107.ec2.internal\" (UID: \"315bddd24f7efc22924c6fa01e51e8cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.133860 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.133815 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.159634 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.159710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.159710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315bddd24f7efc22924c6fa01e51e8cc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-107.ec2.internal\" (UID: \"315bddd24f7efc22924c6fa01e51e8cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.159710 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159696 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/315bddd24f7efc22924c6fa01e51e8cc-config\") pod \"kube-apiserver-proxy-ip-10-0-139-107.ec2.internal\" (UID: \"315bddd24f7efc22924c6fa01e51e8cc\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.159804 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159708 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.159804 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.159730 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e246ac7e4feeef3f23538511faa2a938-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal\" (UID: \"e246ac7e4feeef3f23538511faa2a938\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.234784 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.234765 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.335462 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.335438 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.356603 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.356581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.359926 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.359908 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:31.436543 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.436496 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.536997 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.536978 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.637419 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.637398 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.738109 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.738057 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.792558 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.792539 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 07 19:50:31.793056 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.792671 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 07 19:50:31.839061 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.839034 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.860082 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.860047 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-06 19:45:30 +0000 UTC" deadline="2027-11-27 09:14:53.326170856 +0000 UTC" Jun 07 19:50:31.860082 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.860074 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12901h24m21.466100677s" Jun 07 19:50:31.890286 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:31.890081 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod315bddd24f7efc22924c6fa01e51e8cc.slice/crio-9bf40769a8927b5baff91795927601d08c8e354bcf37e2d1c96575ff28d5e96b WatchSource:0}: Error finding container 9bf40769a8927b5baff91795927601d08c8e354bcf37e2d1c96575ff28d5e96b: Status 404 returned error can't find the container with id 9bf40769a8927b5baff91795927601d08c8e354bcf37e2d1c96575ff28d5e96b Jun 07 19:50:31.894827 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.894814 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 19:50:31.931208 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.931165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" event={"ID":"e246ac7e4feeef3f23538511faa2a938","Type":"ContainerStarted","Data":"8465b3f9334be0ea95da30f3e10a0b2b8a6877abc4b057187f0a3d0fb8e130a9"} Jun 07 19:50:31.932115 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.932094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" event={"ID":"315bddd24f7efc22924c6fa01e51e8cc","Type":"ContainerStarted","Data":"9bf40769a8927b5baff91795927601d08c8e354bcf37e2d1c96575ff28d5e96b"} Jun 07 19:50:31.939253 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:31.939239 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-107.ec2.internal\" not found" Jun 07 19:50:31.994953 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:31.994902 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:50:32.009117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.009097 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:50:32.014302 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.014285 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:50:32.058065 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.058046 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" Jun 07 19:50:32.068506 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.068491 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 19:50:32.069601 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.069589 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" Jun 07 19:50:32.077084 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.077073 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 07 19:50:32.833854 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.833825 2576 apiserver.go:52] "Watching apiserver" Jun 07 19:50:32.841048 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.841027 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 07 19:50:32.841489 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.841463 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-cd7jv","openshift-multus/multus-wcwv2","openshift-network-diagnostics/network-check-target-n7748","openshift-ovn-kubernetes/ovnkube-node-6qcvq","kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn","openshift-cluster-node-tuning-operator/tuned-d7q6n","openshift-dns/node-resolver-pxnq7","openshift-image-registry/node-ca-vb2md","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal","openshift-multus/network-metrics-daemon-npn6t","openshift-network-operator/iptables-alerter-kk2bx","kube-system/global-pull-secret-syncer-nt4x2","kube-system/konnectivity-agent-b29wt"] Jun 07 19:50:32.843953 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.843933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.845972 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.845952 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:32.846109 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.846046 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:32.846345 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.846326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tbl5g\"" Jun 07 19:50:32.846477 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.846452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.846477 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.846452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.848115 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.848064 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:32.848221 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.848159 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:32.850422 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.850401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.852822 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.852549 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.852822 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.852600 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.852978 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.852864 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 07 19:50:32.853030 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.852995 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 07 19:50:32.853030 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.853012 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 07 19:50:32.853176 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.853162 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nvn9w\"" Jun 07 19:50:32.853232 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.853178 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.854020 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.854000 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 07 19:50:32.854823 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.854794 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 07 19:50:32.854908 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.854878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 07 19:50:32.854908 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.854883 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5bn6f\"" Jun 07 19:50:32.855002 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.854939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.856944 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.856925 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 07 19:50:32.857047 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.857025 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wfjm2\"" Jun 07 19:50:32.857118 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.857053 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.857196 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.857175 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.857250 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.857207 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.858024 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.857988 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 07 19:50:32.859121 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.859102 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.859584 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.859379 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 07 19:50:32.859584 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.859437 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ngdxz\"" Jun 07 19:50:32.859584 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.859384 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.859815 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.859629 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.859815 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.859680 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:32.861814 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.861794 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.864011 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.863933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-4dr5f\"" Jun 07 19:50:32.864801 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.864402 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.864801 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.864701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 07 19:50:32.864801 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.864713 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.864985 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.864835 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 07 19:50:32.866208 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.866187 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:32.867828 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867713 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-systemd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.867828 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-var-lib-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.867828 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-etc-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.867828 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867853 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-sys\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867880 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94da0729-0586-4e21-9689-035efa5efa5e-host\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867927 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-ovn\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-node-log\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-netd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.867995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-env-overrides\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-modprobe-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868037 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-kubernetes\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-run\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868083 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-tuned\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcmxn\" (UniqueName: \"kubernetes.io/projected/99c5bc9c-7d68-4858-b19a-4163416b2fb8-kube-api-access-tcmxn\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868127 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jbc5\" (UniqueName: \"kubernetes.io/projected/94da0729-0586-4e21-9689-035efa5efa5e-kube-api-access-2jbc5\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868164 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868129 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-systemd-units\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868302 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysconfig\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868315 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868324 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712460e9-634e-4c3e-95cb-b5ba282f4c0e-agent-certs\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868346 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49bnh\" (UniqueName: \"kubernetes.io/projected/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kube-api-access-49bnh\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868369 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-dbus\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.868401 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-log-socket\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868492 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868514 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8d8zr\"" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-var-lib-kubelet\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-device-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-conf\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-systemd\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-host\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868708 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-slash\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-bin\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-config\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868829 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-lib-modules\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868854 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-kubelet-config\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.868955 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868930 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868964 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.868975 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-script-lib\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkpsd\" (UniqueName: \"kubernetes.io/projected/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-kube-api-access-hkpsd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869057 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869079 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-tmp\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869100 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712460e9-634e-4c3e-95cb-b5ba282f4c0e-konnectivity-ca\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-socket-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869176 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94da0729-0586-4e21-9689-035efa5efa5e-serviceca\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869199 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm6x9\" (UniqueName: \"kubernetes.io/projected/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-kube-api-access-mm6x9\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869247 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-registration-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-sys-fs\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869291 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-kubelet\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869316 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-netns\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.869669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.869611 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 07 19:50:32.871088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.871069 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 07 19:50:32.871331 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.871315 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zvppb\"" Jun 07 19:50:32.871666 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.871457 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:32.871666 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.871522 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 07 19:50:32.873826 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.873620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 07 19:50:32.873826 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.873720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 07 19:50:32.873826 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.873731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bmf5d\"" Jun 07 19:50:32.873826 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.873758 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:50:32.890874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.890858 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8w59" Jun 07 19:50:32.897995 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.897968 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j8w59" Jun 07 19:50:32.959067 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.959043 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 07 19:50:32.969889 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94da0729-0586-4e21-9689-035efa5efa5e-host\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.969986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969896 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-daemon-config\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.969986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969921 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/94da0729-0586-4e21-9689-035efa5efa5e-host\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.969986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969873 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 07 19:50:32.969986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8g8b\" (UniqueName: \"kubernetes.io/projected/ad217ed7-987b-47ab-9dcb-ac81ea77a425-kube-api-access-g8g8b\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.969986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.969973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvnlr\" (UniqueName: \"kubernetes.io/projected/749290f1-4da1-4218-8053-33b5c2b04c70-kube-api-access-qvnlr\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970008 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-modprobe-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-kubernetes\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970060 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-run\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-tuned\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-log-socket\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-kubernetes\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-log-socket\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970170 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-run\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970171 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-modprobe-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970227 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970246 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-system-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-netns\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970309 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysconfig\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712460e9-634e-4c3e-95cb-b5ba282f4c0e-agent-certs\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970358 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49bnh\" (UniqueName: \"kubernetes.io/projected/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kube-api-access-49bnh\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970382 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-dbus\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970358 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970400 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysconfig\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9knrw\" (UniqueName: \"kubernetes.io/projected/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-kube-api-access-9knrw\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970454 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970476 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/749290f1-4da1-4218-8053-33b5c2b04c70-host-slash\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-device-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970541 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-k8s-cni-cncf-io\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970602 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-systemd\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-host\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-bin\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.970817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-config\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970760 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-bin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-dbus\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970798 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-conf-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-system-cni-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970922 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-kubelet-config\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.970982 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-host\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-bin\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971072 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-script-lib\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-systemd\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971107 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-tmp-dir\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971075 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971199 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-device-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971231 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-tmp\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971293 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712460e9-634e-4c3e-95cb-b5ba282f4c0e-konnectivity-ca\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-kubelet\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.971644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-netns\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-systemd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971513 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-multus\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-os-release\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971545 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-config\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-registration-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-var-lib-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971695 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-ovn\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971707 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-kubelet\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-node-log\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-netd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971837 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-env-overrides\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-os-release\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-sys\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971958 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cnibin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.971985 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-multus-certs\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.972461 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.972028 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-etc-kubernetes\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.973163 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.972407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-hosts-file\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973452 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-netns\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973467 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973550 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcmxn\" (UniqueName: \"kubernetes.io/projected/99c5bc9c-7d68-4858-b19a-4163416b2fb8-kube-api-access-tcmxn\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-sys\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jbc5\" (UniqueName: \"kubernetes.io/projected/94da0729-0586-4e21-9689-035efa5efa5e-kube-api-access-2jbc5\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973618 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-ovn\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973654 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-node-log\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-systemd-units\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-cni-netd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973747 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovn-node-metrics-cert\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-kubelet\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-hostroot\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973863 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-ovnkube-script-lib\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.973874 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-cnibin\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.973888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-var-lib-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974009 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-registration-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-tmp\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974425 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-systemd-units\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974468 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-tuned\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-run-systemd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.974473 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974522 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-socket-dir-parent\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.974660 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.974634 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:33.474613914 +0000 UTC m=+3.057129190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974691 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974766 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g64lm\" (UniqueName: \"kubernetes.io/projected/2093ed5a-364b-4deb-8ef5-98cc24058563-kube-api-access-g64lm\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974792 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/749290f1-4da1-4218-8053-33b5c2b04c70-iptables-alerter-script\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974819 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c21e2990-219c-4b52-94ed-60a7676b57a3-kubelet-config\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.974826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-var-lib-kubelet\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.975164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975117 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.975483 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975301 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-var-lib-kubelet\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.975483 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975316 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-conf\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.975483 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.975625 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-slash\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.975625 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkpsd\" (UniqueName: \"kubernetes.io/projected/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-kube-api-access-hkpsd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.975625 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975615 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-lib-modules\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.975774 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.975825 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712460e9-634e-4c3e-95cb-b5ba282f4c0e-konnectivity-ca\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.975825 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975791 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.975917 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-socket-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.975917 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975845 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-slash\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.975917 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975862 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94da0729-0586-4e21-9689-035efa5efa5e-serviceca\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.976057 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975926 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-lib-modules\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.976057 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.975972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:32.976057 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976004 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm6x9\" (UniqueName: \"kubernetes.io/projected/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-kube-api-access-mm6x9\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:32.976057 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976037 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-etc-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.976278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.976278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cni-binary-copy\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:32.976278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-sys-fs\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.976278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976243 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-env-overrides\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.976278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976260 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-sys-fs\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.976508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976399 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712460e9-634e-4c3e-95cb-b5ba282f4c0e-agent-certs\") pod \"konnectivity-agent-b29wt\" (UID: \"712460e9-634e-4c3e-95cb-b5ba282f4c0e\") " pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:32.976559 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.976507 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:32.976607 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.976565 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:33.476543122 +0000 UTC m=+3.059058382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:32.976607 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976586 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-etc-openvswitch\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.976704 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.976652 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/94da0729-0586-4e21-9689-035efa5efa5e-serviceca\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.977449 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.977352 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-host-run-ovn-kubernetes\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.977578 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.977475 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-socket-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.977699 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.977682 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-d\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.977880 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.977754 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.977880 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.977782 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/99c5bc9c-7d68-4858-b19a-4163416b2fb8-etc-sysctl-conf\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.979315 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.979295 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49bnh\" (UniqueName: \"kubernetes.io/projected/5f58a660-51cb-4077-b0a7-6bd19623ffc2-kube-api-access-49bnh\") pod \"aws-ebs-csi-driver-node-8lbzn\" (UID: \"5f58a660-51cb-4077-b0a7-6bd19623ffc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:32.983636 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.983614 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:32.983734 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.983640 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:32.983734 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.983654 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:32.983734 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:32.983718 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:33.48370264 +0000 UTC m=+3.066217912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:32.984942 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.984923 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcmxn\" (UniqueName: \"kubernetes.io/projected/99c5bc9c-7d68-4858-b19a-4163416b2fb8-kube-api-access-tcmxn\") pod \"tuned-d7q6n\" (UID: \"99c5bc9c-7d68-4858-b19a-4163416b2fb8\") " pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:32.986364 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.986342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jbc5\" (UniqueName: \"kubernetes.io/projected/94da0729-0586-4e21-9689-035efa5efa5e-kube-api-access-2jbc5\") pod \"node-ca-vb2md\" (UID: \"94da0729-0586-4e21-9689-035efa5efa5e\") " pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:32.986462 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.986448 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkpsd\" (UniqueName: \"kubernetes.io/projected/94b792e8-7bff-40d9-8654-86bf4f6fd2d9-kube-api-access-hkpsd\") pod \"ovnkube-node-6qcvq\" (UID: \"94b792e8-7bff-40d9-8654-86bf4f6fd2d9\") " pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:32.987294 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:32.987272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm6x9\" (UniqueName: \"kubernetes.io/projected/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-kube-api-access-mm6x9\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:33.076416 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076416 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076420 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cni-binary-copy\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076441 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-daemon-config\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8g8b\" (UniqueName: \"kubernetes.io/projected/ad217ed7-987b-47ab-9dcb-ac81ea77a425-kube-api-access-g8g8b\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076483 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvnlr\" (UniqueName: \"kubernetes.io/projected/749290f1-4da1-4218-8053-33b5c2b04c70-kube-api-access-qvnlr\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.076613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076510 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-system-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076613 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076557 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-netns\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076615 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-netns\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076636 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-system-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9knrw\" (UniqueName: \"kubernetes.io/projected/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-kube-api-access-9knrw\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076724 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/749290f1-4da1-4218-8053-33b5c2b04c70-host-slash\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-k8s-cni-cncf-io\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-cni-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076764 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-bin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076791 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-bin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-conf-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-system-cni-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.076860 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-tmp-dir\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076890 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-multus\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076907 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/749290f1-4da1-4218-8053-33b5c2b04c70-host-slash\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076978 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-os-release\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.076914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-os-release\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-os-release\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cnibin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-system-cni-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077086 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cnibin\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077100 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-cni-binary-copy\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077106 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-conf-dir\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-os-release\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-k8s-cni-cncf-io\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-multus-certs\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-etc-kubernetes\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-run-multus-certs\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077187 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-cni-multus\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077266 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-etc-kubernetes\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.077423 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-hosts-file\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077319 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-binary-copy\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-kubelet\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-hosts-file\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-hostroot\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077356 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-tmp-dir\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-cnibin\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077389 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-host-var-lib-kubelet\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-daemon-config\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077411 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-socket-dir-parent\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077406 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-hostroot\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077436 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077444 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-cnibin\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ad217ed7-987b-47ab-9dcb-ac81ea77a425-multus-socket-dir-parent\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g64lm\" (UniqueName: \"kubernetes.io/projected/2093ed5a-364b-4deb-8ef5-98cc24058563-kube-api-access-g64lm\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077560 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/749290f1-4da1-4218-8053-33b5c2b04c70-iptables-alerter-script\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.078781 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2093ed5a-364b-4deb-8ef5-98cc24058563-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078781 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.078781 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/749290f1-4da1-4218-8053-33b5c2b04c70-iptables-alerter-script\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.078781 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.077988 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2093ed5a-364b-4deb-8ef5-98cc24058563-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.084850 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.084800 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8g8b\" (UniqueName: \"kubernetes.io/projected/ad217ed7-987b-47ab-9dcb-ac81ea77a425-kube-api-access-g8g8b\") pod \"multus-wcwv2\" (UID: \"ad217ed7-987b-47ab-9dcb-ac81ea77a425\") " pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.085093 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.085072 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g64lm\" (UniqueName: \"kubernetes.io/projected/2093ed5a-364b-4deb-8ef5-98cc24058563-kube-api-access-g64lm\") pod \"multus-additional-cni-plugins-cd7jv\" (UID: \"2093ed5a-364b-4deb-8ef5-98cc24058563\") " pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.085202 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.085072 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9knrw\" (UniqueName: \"kubernetes.io/projected/02bb1a1e-07bd-4524-bcdb-bb70bf76310d-kube-api-access-9knrw\") pod \"node-resolver-pxnq7\" (UID: \"02bb1a1e-07bd-4524-bcdb-bb70bf76310d\") " pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.085298 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.085273 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvnlr\" (UniqueName: \"kubernetes.io/projected/749290f1-4da1-4218-8053-33b5c2b04c70-kube-api-access-qvnlr\") pod \"iptables-alerter-kk2bx\" (UID: \"749290f1-4da1-4218-8053-33b5c2b04c70\") " pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.154235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.154209 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" Jun 07 19:50:33.164296 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.164274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:50:33.172559 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.172541 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:33.178246 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.178229 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" Jun 07 19:50:33.184966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.184951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vb2md" Jun 07 19:50:33.190601 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.190586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wcwv2" Jun 07 19:50:33.196972 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.196955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pxnq7" Jun 07 19:50:33.202797 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.202780 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" Jun 07 19:50:33.208337 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.208321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kk2bx" Jun 07 19:50:33.480200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.480113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:33.480200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.480194 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:33.480378 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.480264 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:33.480378 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.480292 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:33.480378 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.480364 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:34.480327921 +0000 UTC m=+4.062843188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:33.480531 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.480386 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:34.480375024 +0000 UTC m=+4.062890284 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:33.580704 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.580670 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:33.580875 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.580853 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:33.580931 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.580882 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:33.580931 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.580895 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:33.581019 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.580992 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:34.580973442 +0000 UTC m=+4.163488715 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:33.661862 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.661836 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2093ed5a_364b_4deb_8ef5_98cc24058563.slice/crio-1739d14990539949e857666a7aa981b3ce03807a4075f719c364c8a11132cc7c WatchSource:0}: Error finding container 1739d14990539949e857666a7aa981b3ce03807a4075f719c364c8a11132cc7c: Status 404 returned error can't find the container with id 1739d14990539949e857666a7aa981b3ce03807a4075f719c364c8a11132cc7c Jun 07 19:50:33.662896 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.662874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712460e9_634e_4c3e_95cb_b5ba282f4c0e.slice/crio-8dfd4c4d3316f83a5a3f27b44e518f05ae1426bc1c5177e095b6149f107cb7c3 WatchSource:0}: Error finding container 8dfd4c4d3316f83a5a3f27b44e518f05ae1426bc1c5177e095b6149f107cb7c3: Status 404 returned error can't find the container with id 8dfd4c4d3316f83a5a3f27b44e518f05ae1426bc1c5177e095b6149f107cb7c3 Jun 07 19:50:33.663847 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.663822 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod749290f1_4da1_4218_8053_33b5c2b04c70.slice/crio-6c683cc3332597b41ce3def95b716aedd66f22d6e1ad678d7bf6dd0fbc5a7333 WatchSource:0}: Error finding container 6c683cc3332597b41ce3def95b716aedd66f22d6e1ad678d7bf6dd0fbc5a7333: Status 404 returned error can't find the container with id 6c683cc3332597b41ce3def95b716aedd66f22d6e1ad678d7bf6dd0fbc5a7333 Jun 07 19:50:33.667121 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.667097 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02bb1a1e_07bd_4524_bcdb_bb70bf76310d.slice/crio-7b3190c129b4ef6c747cd824c3d810dfd79534ece73bd59110222a3b5be4bd0b WatchSource:0}: Error finding container 7b3190c129b4ef6c747cd824c3d810dfd79534ece73bd59110222a3b5be4bd0b: Status 404 returned error can't find the container with id 7b3190c129b4ef6c747cd824c3d810dfd79534ece73bd59110222a3b5be4bd0b Jun 07 19:50:33.667978 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.667912 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94da0729_0586_4e21_9689_035efa5efa5e.slice/crio-227234bb15e5da1d79f97b100edd063bc345c510a1141e5e70944706c10f9213 WatchSource:0}: Error finding container 227234bb15e5da1d79f97b100edd063bc345c510a1141e5e70944706c10f9213: Status 404 returned error can't find the container with id 227234bb15e5da1d79f97b100edd063bc345c510a1141e5e70944706c10f9213 Jun 07 19:50:33.668607 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.668532 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f58a660_51cb_4077_b0a7_6bd19623ffc2.slice/crio-c579c1a4d23df78d530f4f7ca4ccbaa14972de0e13204519cf390d88b710aa60 WatchSource:0}: Error finding container c579c1a4d23df78d530f4f7ca4ccbaa14972de0e13204519cf390d88b710aa60: Status 404 returned error can't find the container with id c579c1a4d23df78d530f4f7ca4ccbaa14972de0e13204519cf390d88b710aa60 Jun 07 19:50:33.669201 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.669180 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c5bc9c_7d68_4858_b19a_4163416b2fb8.slice/crio-98a056c54afbe9ffec4bbb40abc9889df2ce18e6623d3a42d03e355f05a82f37 WatchSource:0}: Error finding container 98a056c54afbe9ffec4bbb40abc9889df2ce18e6623d3a42d03e355f05a82f37: Status 404 returned error can't find the container with id 98a056c54afbe9ffec4bbb40abc9889df2ce18e6623d3a42d03e355f05a82f37 Jun 07 19:50:33.671068 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.671013 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94b792e8_7bff_40d9_8654_86bf4f6fd2d9.slice/crio-f1d2abc54396e7271309ab3b42de3e21efff2e5c9bf32de51acefa65c9d147ae WatchSource:0}: Error finding container f1d2abc54396e7271309ab3b42de3e21efff2e5c9bf32de51acefa65c9d147ae: Status 404 returned error can't find the container with id f1d2abc54396e7271309ab3b42de3e21efff2e5c9bf32de51acefa65c9d147ae Jun 07 19:50:33.674196 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:50:33.674174 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad217ed7_987b_47ab_9dcb_ac81ea77a425.slice/crio-55898553d6e5dceda1eb0d6b89bb3e63519c1a6e09fd5a76aa951a552d4876ef WatchSource:0}: Error finding container 55898553d6e5dceda1eb0d6b89bb3e63519c1a6e09fd5a76aa951a552d4876ef: Status 404 returned error can't find the container with id 55898553d6e5dceda1eb0d6b89bb3e63519c1a6e09fd5a76aa951a552d4876ef Jun 07 19:50:33.901370 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.901339 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 19:45:32 +0000 UTC" deadline="2027-11-04 14:17:37.749559024 +0000 UTC" Jun 07 19:50:33.901370 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.901366 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12354h27m3.848195969s" Jun 07 19:50:33.928644 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.928624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:33.928771 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:33.928736 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:33.936695 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.936673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" event={"ID":"315bddd24f7efc22924c6fa01e51e8cc","Type":"ContainerStarted","Data":"21b3724549a8d8382c12d8b33e3aff1a5a67545534ef23aa55917034f1153f66"} Jun 07 19:50:33.937758 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.937739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vb2md" event={"ID":"94da0729-0586-4e21-9689-035efa5efa5e","Type":"ContainerStarted","Data":"227234bb15e5da1d79f97b100edd063bc345c510a1141e5e70944706c10f9213"} Jun 07 19:50:33.938760 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.938743 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"f1d2abc54396e7271309ab3b42de3e21efff2e5c9bf32de51acefa65c9d147ae"} Jun 07 19:50:33.940075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.940048 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b29wt" event={"ID":"712460e9-634e-4c3e-95cb-b5ba282f4c0e","Type":"ContainerStarted","Data":"8dfd4c4d3316f83a5a3f27b44e518f05ae1426bc1c5177e095b6149f107cb7c3"} Jun 07 19:50:33.941201 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.941178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerStarted","Data":"1739d14990539949e857666a7aa981b3ce03807a4075f719c364c8a11132cc7c"} Jun 07 19:50:33.942315 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.942278 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" event={"ID":"99c5bc9c-7d68-4858-b19a-4163416b2fb8","Type":"ContainerStarted","Data":"98a056c54afbe9ffec4bbb40abc9889df2ce18e6623d3a42d03e355f05a82f37"} Jun 07 19:50:33.943638 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.943613 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" event={"ID":"5f58a660-51cb-4077-b0a7-6bd19623ffc2","Type":"ContainerStarted","Data":"c579c1a4d23df78d530f4f7ca4ccbaa14972de0e13204519cf390d88b710aa60"} Jun 07 19:50:33.944771 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.944750 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wcwv2" event={"ID":"ad217ed7-987b-47ab-9dcb-ac81ea77a425","Type":"ContainerStarted","Data":"55898553d6e5dceda1eb0d6b89bb3e63519c1a6e09fd5a76aa951a552d4876ef"} Jun 07 19:50:33.946340 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.946317 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxnq7" event={"ID":"02bb1a1e-07bd-4524-bcdb-bb70bf76310d","Type":"ContainerStarted","Data":"7b3190c129b4ef6c747cd824c3d810dfd79534ece73bd59110222a3b5be4bd0b"} Jun 07 19:50:33.947608 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:33.947586 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk2bx" event={"ID":"749290f1-4da1-4218-8053-33b5c2b04c70","Type":"ContainerStarted","Data":"6c683cc3332597b41ce3def95b716aedd66f22d6e1ad678d7bf6dd0fbc5a7333"} Jun 07 19:50:34.487713 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.487616 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:34.487713 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.487697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:34.488005 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.487936 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:34.488005 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.487998 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:36.487980699 +0000 UTC m=+6.070495960 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:34.488497 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.488477 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:34.488585 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.488535 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:36.488518444 +0000 UTC m=+6.071033706 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:34.588728 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.588169 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:34.588728 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.588341 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:34.588728 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.588360 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:34.588728 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.588371 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:34.588728 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.588424 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:36.588406592 +0000 UTC m=+6.170921864 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:34.902108 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.902001 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-06 19:45:32 +0000 UTC" deadline="2028-01-18 07:56:07.273036887 +0000 UTC" Jun 07 19:50:34.902108 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.902061 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14148h5m32.370980127s" Jun 07 19:50:34.931705 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.931254 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:34.931705 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.931260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:34.931705 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.931382 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:34.931705 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:34.931430 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:34.962312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.961131 2576 generic.go:356] "Generic (PLEG): container finished" podID="e246ac7e4feeef3f23538511faa2a938" containerID="159f886750e24208e087bdfb77251c4aa192b2b30aeb3cadd4ff3f9561f6cec5" exitCode=0 Jun 07 19:50:34.962312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.962269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" event={"ID":"e246ac7e4feeef3f23538511faa2a938","Type":"ContainerDied","Data":"159f886750e24208e087bdfb77251c4aa192b2b30aeb3cadd4ff3f9561f6cec5"} Jun 07 19:50:34.976247 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:34.974768 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-107.ec2.internal" podStartSLOduration=2.974751663 podStartE2EDuration="2.974751663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:33.948384614 +0000 UTC m=+3.530899893" watchObservedRunningTime="2026-06-07 19:50:34.974751663 +0000 UTC m=+4.557266943" Jun 07 19:50:35.929315 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:35.929287 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:35.929813 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:35.929413 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:35.983468 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:35.983409 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" event={"ID":"e246ac7e4feeef3f23538511faa2a938","Type":"ContainerStarted","Data":"493a5d4b464e8d3e3dc34e11d67a1719c431c75f44c5bb72be1b14dae824626d"} Jun 07 19:50:36.504883 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:36.504849 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:36.505045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:36.504915 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:36.505045 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.505036 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:36.505188 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.505099 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:40.505079294 +0000 UTC m=+10.087594566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:36.505298 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.505280 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:36.505371 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.505335 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:40.505319929 +0000 UTC m=+10.087835201 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:36.605588 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:36.605526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:36.605763 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.605739 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:36.605763 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.605760 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:36.605900 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.605773 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:36.605900 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.605832 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:40.605813544 +0000 UTC m=+10.188328818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:36.931532 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:36.931021 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:36.931532 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.931125 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:36.931532 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:36.931220 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:36.931532 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:36.931296 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:37.928630 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:37.928597 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:37.928794 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:37.928729 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:38.932292 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:38.932260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:38.932723 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:38.932420 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:38.932723 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:38.932266 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:38.932723 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:38.932531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:39.929852 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:39.929545 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:39.929852 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:39.929679 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:40.539303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:40.539375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.539496 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.539564 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:48.539544202 +0000 UTC m=+18.122059464 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.539601 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:40.539715 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.539641 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:48.539629148 +0000 UTC m=+18.122144417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:40.640255 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:40.640217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:40.640421 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.640400 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:40.640482 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.640426 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:40.640482 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.640440 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:40.640555 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.640495 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:50:48.640479011 +0000 UTC m=+18.222994287 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:40.929301 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:40.929226 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:40.929449 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.929361 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:40.929849 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:40.929826 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:40.929946 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:40.929922 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:41.929666 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:41.929399 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:41.930094 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:41.929662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:42.928902 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:42.928869 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:42.929083 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:42.928976 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:42.929083 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:42.929009 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:42.929083 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:42.929076 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:43.928629 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:43.928602 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:43.928965 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:43.928695 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:44.929615 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:44.929559 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:44.930075 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:44.929728 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:44.930075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:44.929778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:44.930075 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:44.929889 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:45.929264 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:45.929235 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:45.929581 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:45.929359 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:46.928840 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:46.928807 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:46.929298 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:46.928941 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:46.929298 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:46.929001 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:46.929298 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:46.929093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:47.929152 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:47.929105 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:47.929647 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:47.929238 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:48.602154 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:48.602120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:48.602321 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:48.602197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:48.602321 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.602270 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:48.602321 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.602320 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:48.602463 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.602350 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:04.602329003 +0000 UTC m=+34.184844277 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:50:48.602463 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.602375 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:04.60235752 +0000 UTC m=+34.184872779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:50:48.702960 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:48.702918 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:48.703118 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.703046 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:50:48.703118 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.703062 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:50:48.703118 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.703071 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:48.703118 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.703118 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:04.703104587 +0000 UTC m=+34.285619846 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:50:48.929597 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:48.929566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:48.929967 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:48.929567 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:48.929967 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.929711 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:48.929967 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:48.929812 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:49.929653 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:49.929620 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:49.930100 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:49.929731 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:50.929627 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:50.929592 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:50.929802 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:50.929719 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:50.929802 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:50.929773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:50.930235 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:50.929881 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:51.928724 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:51.928694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:51.928905 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:51.928794 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:52.929365 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:52.929192 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:52.930191 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:52.929204 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:52.930191 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:52.929466 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:52.930191 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:52.929593 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:53.018097 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.018069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" event={"ID":"99c5bc9c-7d68-4858-b19a-4163416b2fb8","Type":"ContainerStarted","Data":"d0d7354437a6dc0aad9c92067a691f1cd4e60296ce6530bb941eb3e4e9943bc7"} Jun 07 19:50:53.019686 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.019659 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" event={"ID":"5f58a660-51cb-4077-b0a7-6bd19623ffc2","Type":"ContainerStarted","Data":"69743bd4308c0755517a63846f7f657bd84b0ed049265b672b45b8bf9aca3515"} Jun 07 19:50:53.021119 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.021088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wcwv2" event={"ID":"ad217ed7-987b-47ab-9dcb-ac81ea77a425","Type":"ContainerStarted","Data":"b7765c47a7ac883b1b86b98d0e1097d122ded0c9a6495838dde113da886b3eb2"} Jun 07 19:50:53.022660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.022629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pxnq7" event={"ID":"02bb1a1e-07bd-4524-bcdb-bb70bf76310d","Type":"ContainerStarted","Data":"aff82b7205fe06b718cb8db9fe2b2908f6f6e4bbc2f02433ff1a417302cbe860"} Jun 07 19:50:53.024010 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.023988 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vb2md" event={"ID":"94da0729-0586-4e21-9689-035efa5efa5e","Type":"ContainerStarted","Data":"89fe1930c537720f3f736fd968ca64c4919877167f68bc983db8eb52deac5ba1"} Jun 07 19:50:53.025551 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.025510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"fb8a8f6a2f1a3891bc2baa1c5f729289839e14b4da682f56ff30d98b8d94ce52"} Jun 07 19:50:53.026918 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.026900 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-b29wt" event={"ID":"712460e9-634e-4c3e-95cb-b5ba282f4c0e","Type":"ContainerStarted","Data":"c8ff89d0adab2f040f11e004fd2c48666d1afe2a34453a5f482eb8145bf4237d"} Jun 07 19:50:53.030496 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.029049 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="61588dcb23f7adafc0d480e70472bd012734f3ee7cb371987c33a68b7e2fd2cd" exitCode=0 Jun 07 19:50:53.030496 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.029092 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"61588dcb23f7adafc0d480e70472bd012734f3ee7cb371987c33a68b7e2fd2cd"} Jun 07 19:50:53.032275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.032231 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-d7q6n" podStartSLOduration=3.136965139 podStartE2EDuration="22.032216246s" totalImagesPullingTime="18.895251107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:53.031915377 +0000 UTC m=+22.614430657" watchObservedRunningTime="2026-06-07 19:50:53.032216246 +0000 UTC m=+22.614731528" Jun 07 19:50:53.032500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.032469 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-107.ec2.internal" podStartSLOduration=21.032458382 podStartE2EDuration="21.032458382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:35.998215253 +0000 UTC m=+5.580730538" watchObservedRunningTime="2026-06-07 19:50:53.032458382 +0000 UTC m=+22.614973661" Jun 07 19:50:53.043956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.043921 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vb2md" podStartSLOduration=3.203741688 podStartE2EDuration="22.043909918s" totalImagesPullingTime="18.84016823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:53.043856964 +0000 UTC m=+22.626372243" watchObservedRunningTime="2026-06-07 19:50:53.043909918 +0000 UTC m=+22.626425198" Jun 07 19:50:53.058295 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.058265 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wcwv2" podStartSLOduration=3.132619146 podStartE2EDuration="22.058253511s" totalImagesPullingTime="18.925634365s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:53.058033162 +0000 UTC m=+22.640548442" watchObservedRunningTime="2026-06-07 19:50:53.058253511 +0000 UTC m=+22.640768791" Jun 07 19:50:53.072436 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.072407 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pxnq7" podStartSLOduration=3.175666696 podStartE2EDuration="22.072397076s" totalImagesPullingTime="18.89673038s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:53.072281756 +0000 UTC m=+22.654797035" watchObservedRunningTime="2026-06-07 19:50:53.072397076 +0000 UTC m=+22.654912355" Jun 07 19:50:53.103108 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.103056 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-b29wt" podStartSLOduration=3.647364707 podStartE2EDuration="22.103046502s" totalImagesPullingTime="18.455681795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:53.103017778 +0000 UTC m=+22.685533059" watchObservedRunningTime="2026-06-07 19:50:53.103046502 +0000 UTC m=+22.685561782" Jun 07 19:50:53.929098 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.928935 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:53.929295 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:53.929275 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:53.981411 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:53.981385 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 07 19:50:54.034976 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.034950 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:50:54.035365 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035343 2576 generic.go:356] "Generic (PLEG): container finished" podID="94b792e8-7bff-40d9-8654-86bf4f6fd2d9" containerID="269438e331d5157db320e31fae64fc35167828fbac40ecb28149f2f9d7f41bd2" exitCode=1 Jun 07 19:50:54.035469 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035397 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"64ba41f78848a2e4f33fea4a4207d4bf4e36b3b4cee0c80660c176f23c1a000c"} Jun 07 19:50:54.035516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035492 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"70a20ddfe99569c3ec4279d94530cc48dbdb1811acbec12a0c9620a72dd04171"} Jun 07 19:50:54.035566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035542 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"fc14e01bed0e2807307bc3baa0f68b08d3e33f2245a76ce42bea9dfca48c82e1"} Jun 07 19:50:54.035610 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"47231df7aeb29040aad0a5748081fcf73bc8471a5bbe62fe7eede24d050277a5"} Jun 07 19:50:54.035654 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.035636 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerDied","Data":"269438e331d5157db320e31fae64fc35167828fbac40ecb28149f2f9d7f41bd2"} Jun 07 19:50:54.037488 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.037454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" event={"ID":"5f58a660-51cb-4077-b0a7-6bd19623ffc2","Type":"ContainerStarted","Data":"55306c96e7635b7133b89c5cae87d844afeec6fe72d5a12b5ca135b1522244cf"} Jun 07 19:50:54.039203 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.039157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kk2bx" event={"ID":"749290f1-4da1-4218-8053-33b5c2b04c70","Type":"ContainerStarted","Data":"e8df2a6c556d811c27839abfee66baaa522c2b5fd9ef78378b2e8a1d1c926e7c"} Jun 07 19:50:54.054646 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.052568 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kk2bx" podStartSLOduration=4.151940822 podStartE2EDuration="23.052553163s" totalImagesPullingTime="18.900612341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:54.052013202 +0000 UTC m=+23.634528470" watchObservedRunningTime="2026-06-07 19:50:54.052553163 +0000 UTC m=+23.635068448" Jun 07 19:50:54.565378 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.565267 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:54.566113 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.565919 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:54.928032 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.927943 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-07T19:50:53.981407056Z","UUID":"6889c179-ee35-48f1-8184-63bbecebb73c","Handler":null,"Name":"","Endpoint":""} Jun 07 19:50:54.928798 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.928778 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:54.928937 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:54.928910 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:54.929358 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.929339 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:54.929449 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:54.929435 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:54.930074 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.930057 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 07 19:50:54.930166 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:54.930112 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 07 19:50:55.043879 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:55.043844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" event={"ID":"5f58a660-51cb-4077-b0a7-6bd19623ffc2","Type":"ContainerStarted","Data":"8518a81a968adea125c26842a2d66243da881950767623f60a3ae643ba39d1bf"} Jun 07 19:50:55.044464 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:55.044275 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:55.044755 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:55.044735 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-b29wt" Jun 07 19:50:55.059539 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:55.059491 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8lbzn" podStartSLOduration=3.228096294 podStartE2EDuration="24.059475049s" totalImagesPullingTime="20.831378755s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:50:55.059452984 +0000 UTC m=+24.641968266" watchObservedRunningTime="2026-06-07 19:50:55.059475049 +0000 UTC m=+24.641990330" Jun 07 19:50:55.928643 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:55.928615 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:55.928801 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:55.928735 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:56.928888 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:56.928854 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:56.929651 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:56.928900 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:56.929651 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:56.928973 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:56.929651 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:56.929083 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:57.929450 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:57.929420 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:57.929951 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:57.929513 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:50:58.052071 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.052043 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:50:58.052441 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.052421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"c35763cf3fea13d57814b4225e0941ddb3b4fc5f8524cf1b39e5d654119fa33e"} Jun 07 19:50:58.054008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.053987 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="2851c966bebc557abf05e2dbcee4485eec9c397960d439fd6d181133cd3a4a22" exitCode=0 Jun 07 19:50:58.054093 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.054014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"2851c966bebc557abf05e2dbcee4485eec9c397960d439fd6d181133cd3a4a22"} Jun 07 19:50:58.929416 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.929387 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:50:58.929713 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:58.929496 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:50:58.929713 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:58.929558 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:50:58.929713 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:58.929647 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:50:59.929541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:50:59.929358 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:50:59.929710 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:50:59.929606 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:51:00.062831 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.062807 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:51:00.063246 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.063131 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"f7f5d463ba387fc87454cf53c5d863c54ab5119b756a6162c14f91194e95e9cb"} Jun 07 19:51:00.065820 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.063764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:00.065820 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.063876 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:00.065820 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.063890 2576 scope.go:117] "RemoveContainer" containerID="269438e331d5157db320e31fae64fc35167828fbac40ecb28149f2f9d7f41bd2" Jun 07 19:51:00.068464 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.068427 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="c1866fcbef3240cb8480c8d8accd00cecfaaf11c3e37f9487f04f6ff906b3ac9" exitCode=0 Jun 07 19:51:00.068464 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.068450 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"c1866fcbef3240cb8480c8d8accd00cecfaaf11c3e37f9487f04f6ff906b3ac9"} Jun 07 19:51:00.080278 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.080260 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:00.929819 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.929790 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:00.929986 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:00.929902 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:51:00.930280 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:00.930015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:00.930280 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:00.930160 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:51:01.074490 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.074295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:51:01.074963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.074933 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" event={"ID":"94b792e8-7bff-40d9-8654-86bf4f6fd2d9","Type":"ContainerStarted","Data":"780964c05c027e5942e010810adfc8ae2da57cf2c75c6dffa86b9e176e906ff4"} Jun 07 19:51:01.075323 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.075305 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:01.093785 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.093763 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:01.104300 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.104264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" podStartSLOduration=10.917383819 podStartE2EDuration="30.104251465s" totalImagesPullingTime="19.186867646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:51:01.102572006 +0000 UTC m=+30.685087321" watchObservedRunningTime="2026-06-07 19:51:01.104251465 +0000 UTC m=+30.686766745" Jun 07 19:51:01.189847 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.189122 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nt4x2"] Jun 07 19:51:01.189847 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.189335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:01.189847 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:01.189522 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:51:01.190168 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.190119 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n7748"] Jun 07 19:51:01.190307 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.190289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:01.190425 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:01.190395 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:51:01.192229 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.192194 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npn6t"] Jun 07 19:51:01.192374 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:01.192343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:01.192478 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:01.192456 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:51:02.079019 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:02.078948 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="b999ff50acf02700ab3f8001c9c7f71fe384b3eccc0dafd432fb0326c5c18789" exitCode=0 Jun 07 19:51:02.079751 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:02.079024 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"b999ff50acf02700ab3f8001c9c7f71fe384b3eccc0dafd432fb0326c5c18789"} Jun 07 19:51:02.929239 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:02.929206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:02.929408 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:02.929206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:02.929408 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:02.929343 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:02.929408 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:02.929335 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:51:02.929600 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:02.929442 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:51:02.929600 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:02.929555 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:51:04.626731 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.626688 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:04.627237 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.626758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:04.627237 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.626858 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 07 19:51:04.627237 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.626871 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:51:04.627237 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.626935 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret podName:c21e2990-219c-4b52-94ed-60a7676b57a3 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:36.62691332 +0000 UTC m=+66.209428601 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret") pod "global-pull-secret-syncer-nt4x2" (UID: "c21e2990-219c-4b52-94ed-60a7676b57a3") : object "kube-system"/"original-pull-secret" not registered Jun 07 19:51:04.627237 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.626952 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:36.626945691 +0000 UTC m=+66.209460950 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 07 19:51:04.728081 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.728046 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:04.728249 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.728182 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 07 19:51:04.728249 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.728197 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 07 19:51:04.728249 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.728208 2576 projected.go:196] Error preparing data for projected volume kube-api-access-lg4bq for pod openshift-network-diagnostics/network-check-target-n7748: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:51:04.728369 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.728260 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq podName:ecac8b5d-cb74-40af-a972-ce0180a63991 nodeName:}" failed. No retries permitted until 2026-06-07 19:51:36.728244119 +0000 UTC m=+66.310759378 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-lg4bq" (UniqueName: "kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq") pod "network-check-target-n7748" (UID: "ecac8b5d-cb74-40af-a972-ce0180a63991") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 07 19:51:04.928965 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.928933 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:04.929169 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.928939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:04.929169 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.929061 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-nt4x2" podUID="c21e2990-219c-4b52-94ed-60a7676b57a3" Jun 07 19:51:04.929169 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:04.928940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:04.929169 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.929153 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:51:04.929386 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:04.929221 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n7748" podUID="ecac8b5d-cb74-40af-a972-ce0180a63991" Jun 07 19:51:05.249359 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.249300 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-107.ec2.internal" event="NodeReady" Jun 07 19:51:05.249516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.249422 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 07 19:51:05.288878 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.288842 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ln9hd"] Jun 07 19:51:05.293187 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.293168 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.294515 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.294485 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-54tzw"] Jun 07 19:51:05.295580 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.295546 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 07 19:51:05.295580 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.295560 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 07 19:51:05.295737 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.295557 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db9r8\"" Jun 07 19:51:05.297059 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.297039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.299059 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.299029 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 07 19:51:05.299311 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.299290 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 07 19:51:05.299450 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.299434 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9fwwm\"" Jun 07 19:51:05.299511 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.299461 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 07 19:51:05.304191 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.304173 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ln9hd"] Jun 07 19:51:05.306511 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.306238 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54tzw"] Jun 07 19:51:05.432798 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.432769 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.432956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.432830 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-config-volume\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.432956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.432861 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0721b842-43b6-42cd-8e69-70da07618f62-cert\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.432956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.432887 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58bgb\" (UniqueName: \"kubernetes.io/projected/0721b842-43b6-42cd-8e69-70da07618f62-kube-api-access-58bgb\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.433100 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.432964 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-tmp-dir\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.433100 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.433004 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbz9f\" (UniqueName: \"kubernetes.io/projected/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-kube-api-access-pbz9f\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534158 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-tmp-dir\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534158 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534123 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbz9f\" (UniqueName: \"kubernetes.io/projected/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-kube-api-access-pbz9f\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534366 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534176 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534366 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534216 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-config-volume\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534366 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0721b842-43b6-42cd-8e69-70da07618f62-cert\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.534366 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58bgb\" (UniqueName: \"kubernetes.io/projected/0721b842-43b6-42cd-8e69-70da07618f62-kube-api-access-58bgb\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.534366 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:05.534327 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:05.534615 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:05.534401 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:06.034381634 +0000 UTC m=+35.616896910 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:05.534615 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534454 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-tmp-dir\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.534838 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.534816 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-config-volume\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.538764 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.538610 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0721b842-43b6-42cd-8e69-70da07618f62-cert\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.542735 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.542675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbz9f\" (UniqueName: \"kubernetes.io/projected/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-kube-api-access-pbz9f\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:05.543344 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.543323 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58bgb\" (UniqueName: \"kubernetes.io/projected/0721b842-43b6-42cd-8e69-70da07618f62-kube-api-access-58bgb\") pod \"ingress-canary-54tzw\" (UID: \"0721b842-43b6-42cd-8e69-70da07618f62\") " pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.613380 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.613350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-54tzw" Jun 07 19:51:05.969923 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:05.969898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-54tzw"] Jun 07 19:51:05.974054 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:51:05.974031 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0721b842_43b6_42cd_8e69_70da07618f62.slice/crio-7e1bd0afb6da6ba3bbf1a8b81c8620c24f1899915b9a8d8524536c3b95e9fee3 WatchSource:0}: Error finding container 7e1bd0afb6da6ba3bbf1a8b81c8620c24f1899915b9a8d8524536c3b95e9fee3: Status 404 returned error can't find the container with id 7e1bd0afb6da6ba3bbf1a8b81c8620c24f1899915b9a8d8524536c3b95e9fee3 Jun 07 19:51:06.038769 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.038729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:06.038885 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:06.038866 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:06.038945 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:06.038930 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:07.038913698 +0000 UTC m=+36.621428968 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:06.089572 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.089541 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54tzw" event={"ID":"0721b842-43b6-42cd-8e69-70da07618f62","Type":"ContainerStarted","Data":"7e1bd0afb6da6ba3bbf1a8b81c8620c24f1899915b9a8d8524536c3b95e9fee3"} Jun 07 19:51:06.092582 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.092535 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerStarted","Data":"2c4f7017d545b8490062907c7a5cd6672288084093abb97a0cb9906ad625dd3e"} Jun 07 19:51:06.928910 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.928867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:06.929088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.928872 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:06.929088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.929006 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:06.931506 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.931487 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 19:51:06.932905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.932706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h6vj\"" Jun 07 19:51:06.932905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.932733 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 19:51:06.932905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.932707 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2jtp\"" Jun 07 19:51:06.932905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.932761 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 19:51:06.932905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:06.932761 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 19:51:07.047395 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:07.047357 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:07.047842 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:07.047461 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:07.047842 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:07.047542 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:09.047524026 +0000 UTC m=+38.630039304 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:07.097991 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:07.097959 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="2c4f7017d545b8490062907c7a5cd6672288084093abb97a0cb9906ad625dd3e" exitCode=0 Jun 07 19:51:07.098161 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:07.098000 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"2c4f7017d545b8490062907c7a5cd6672288084093abb97a0cb9906ad625dd3e"} Jun 07 19:51:08.103129 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:08.102968 2576 generic.go:356] "Generic (PLEG): container finished" podID="2093ed5a-364b-4deb-8ef5-98cc24058563" containerID="fae0ce20bc82d1b8ac1857f35d8bb79fe6f0ef05b6e39639ef1e46b2ba0a5042" exitCode=0 Jun 07 19:51:08.103660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:08.103045 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerDied","Data":"fae0ce20bc82d1b8ac1857f35d8bb79fe6f0ef05b6e39639ef1e46b2ba0a5042"} Jun 07 19:51:08.104653 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:08.104632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-54tzw" event={"ID":"0721b842-43b6-42cd-8e69-70da07618f62","Type":"ContainerStarted","Data":"d20cbeea4426f68b4a018c23209a6473a2fd9d40b43c759e32ff3fb7b43e0864"} Jun 07 19:51:08.137965 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:08.137721 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-54tzw" podStartSLOduration=1.719337329 podStartE2EDuration="3.137702662s" totalImagesPullingTime="1.418365333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:51:08.136896549 +0000 UTC m=+37.719411830" watchObservedRunningTime="2026-06-07 19:51:08.137702662 +0000 UTC m=+37.720217947" Jun 07 19:51:09.059757 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:09.059727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:09.059891 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:09.059847 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:09.059937 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:09.059895 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:13.059882416 +0000 UTC m=+42.642397677 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:09.110583 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:09.110554 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" event={"ID":"2093ed5a-364b-4deb-8ef5-98cc24058563","Type":"ContainerStarted","Data":"efcc51b8b295b31a4a33ea52c280fc46b7e3163826dc79e23408ca84161ba711"} Jun 07 19:51:09.133756 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:09.131528 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cd7jv" podStartSLOduration=9.295422055 podStartE2EDuration="38.131511478s" totalImagesPullingTime="28.836089423s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:51:09.129916508 +0000 UTC m=+38.712431800" watchObservedRunningTime="2026-06-07 19:51:09.131511478 +0000 UTC m=+38.714026758" Jun 07 19:51:13.085962 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:13.085930 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:13.086422 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:13.086044 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:13.086422 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:13.086091 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:21.086078437 +0000 UTC m=+50.668593696 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:21.137134 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:21.137098 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:21.137758 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:21.137218 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:21.137895 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:21.137869 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:51:37.137845417 +0000 UTC m=+66.720360690 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:33.090646 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:33.090620 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6qcvq" Jun 07 19:51:36.637700 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.637665 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:51:36.638070 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.637721 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:36.640161 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.640130 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 07 19:51:36.640161 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.640154 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 07 19:51:36.648212 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:36.648189 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 19:51:36.648292 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:36.648257 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:52:40.648235935 +0000 UTC m=+130.230751207 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : secret "metrics-daemon-secret" not found Jun 07 19:51:36.651456 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.651437 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c21e2990-219c-4b52-94ed-60a7676b57a3-original-pull-secret\") pod \"global-pull-secret-syncer-nt4x2\" (UID: \"c21e2990-219c-4b52-94ed-60a7676b57a3\") " pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:36.653395 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.653378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nt4x2" Jun 07 19:51:36.738430 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.738398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:36.741324 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.741298 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 07 19:51:36.751608 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.751583 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 07 19:51:36.762385 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.762342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg4bq\" (UniqueName: \"kubernetes.io/projected/ecac8b5d-cb74-40af-a972-ce0180a63991-kube-api-access-lg4bq\") pod \"network-check-target-n7748\" (UID: \"ecac8b5d-cb74-40af-a972-ce0180a63991\") " pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:36.803443 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.803418 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nt4x2"] Jun 07 19:51:36.806309 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:51:36.806283 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc21e2990_219c_4b52_94ed_60a7676b57a3.slice/crio-140a11701752d7c9814dcb8efab912b2f7b7b86a881135fcf332e8ceafd461c0 WatchSource:0}: Error finding container 140a11701752d7c9814dcb8efab912b2f7b7b86a881135fcf332e8ceafd461c0: Status 404 returned error can't find the container with id 140a11701752d7c9814dcb8efab912b2f7b7b86a881135fcf332e8ceafd461c0 Jun 07 19:51:36.941910 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.941891 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-5h6vj\"" Jun 07 19:51:36.949875 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:36.949859 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:37.094092 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:37.094020 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n7748"] Jun 07 19:51:37.098515 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:51:37.098492 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecac8b5d_cb74_40af_a972_ce0180a63991.slice/crio-4d7b39640ef33d1dca7bce674c518121182a88579ffdc127e14b40652e6f5599 WatchSource:0}: Error finding container 4d7b39640ef33d1dca7bce674c518121182a88579ffdc127e14b40652e6f5599: Status 404 returned error can't find the container with id 4d7b39640ef33d1dca7bce674c518121182a88579ffdc127e14b40652e6f5599 Jun 07 19:51:37.140679 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:37.140657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:51:37.140773 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:37.140761 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:51:37.140822 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:51:37.140814 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:52:09.140801284 +0000 UTC m=+98.723316542 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:51:37.179194 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:37.179165 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nt4x2" event={"ID":"c21e2990-219c-4b52-94ed-60a7676b57a3","Type":"ContainerStarted","Data":"140a11701752d7c9814dcb8efab912b2f7b7b86a881135fcf332e8ceafd461c0"} Jun 07 19:51:37.180284 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:37.180262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n7748" event={"ID":"ecac8b5d-cb74-40af-a972-ce0180a63991","Type":"ContainerStarted","Data":"4d7b39640ef33d1dca7bce674c518121182a88579ffdc127e14b40652e6f5599"} Jun 07 19:51:42.195604 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:42.195569 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n7748" event={"ID":"ecac8b5d-cb74-40af-a972-ce0180a63991","Type":"ContainerStarted","Data":"a8bc43f6682249c4ea37163490bf730218f36374660fce5faac67e2b6bc10f55"} Jun 07 19:51:42.196075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:42.195644 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:51:42.196966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:42.196942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nt4x2" event={"ID":"c21e2990-219c-4b52-94ed-60a7676b57a3","Type":"ContainerStarted","Data":"956eeb7ded39107ec121c4049a991c33d313eb23c94299f3b516790092d9c4c0"} Jun 07 19:51:42.210386 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:42.210345 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n7748" podStartSLOduration=67.054665282 podStartE2EDuration="1m11.210333385s" totalImagesPullingTime="4.155668103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:51:42.209539019 +0000 UTC m=+71.792054303" watchObservedRunningTime="2026-06-07 19:51:42.210333385 +0000 UTC m=+71.792848665" Jun 07 19:51:42.223023 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:51:42.222982 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nt4x2" podStartSLOduration=66.770286843 podStartE2EDuration="1m11.222970977s" totalImagesPullingTime="4.452684134s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:51:42.222183549 +0000 UTC m=+71.804698824" watchObservedRunningTime="2026-06-07 19:51:42.222970977 +0000 UTC m=+71.805486257" Jun 07 19:52:09.150499 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:52:09.150446 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:52:09.150998 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:52:09.150595 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:52:09.150998 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:52:09.150666 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:53:13.15064977 +0000 UTC m=+162.733165029 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:52:13.201624 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:52:13.201589 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n7748" Jun 07 19:52:40.660806 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:52:40.660761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:52:40.661283 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:52:40.660912 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 07 19:52:40.661283 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:52:40.660978 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs podName:77d8a841-c2b4-47d3-a245-a0f0e4c9fc16 nodeName:}" failed. No retries permitted until 2026-06-07 19:54:42.660961365 +0000 UTC m=+252.243476625 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs") pod "network-metrics-daemon-npn6t" (UID: "77d8a841-c2b4-47d3-a245-a0f0e4c9fc16") : secret "metrics-daemon-secret" not found Jun 07 19:53:08.307258 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:08.307203 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ln9hd" podUID="9ee03617-e2cb-497c-95e4-eb6efdb7b41e" Jun 07 19:53:08.396949 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:08.396925 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:53:09.947019 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:09.946979 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-npn6t" podUID="77d8a841-c2b4-47d3-a245-a0f0e4c9fc16" Jun 07 19:53:13.173837 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:13.173800 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:53:13.174239 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:13.173898 2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 07 19:53:13.174239 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:13.173956 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls podName:9ee03617-e2cb-497c-95e4-eb6efdb7b41e nodeName:}" failed. No retries permitted until 2026-06-07 19:55:15.173940468 +0000 UTC m=+284.756455727 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls") pod "dns-default-ln9hd" (UID: "9ee03617-e2cb-497c-95e4-eb6efdb7b41e") : secret "dns-default-metrics-tls" not found Jun 07 19:53:22.932629 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:22.932563 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:53:34.284454 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.284422 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx"] Jun 07 19:53:34.287179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.287163 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx"] Jun 07 19:53:34.287292 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.287274 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" Jun 07 19:53:34.289566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.289542 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:53:34.289682 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.289653 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-zkx78\"" Jun 07 19:53:34.289682 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.289677 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.292534 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.292514 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 07 19:53:34.298323 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.298304 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 07 19:53:34.299329 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.299314 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 07 19:53:34.302352 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.302333 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx"] Jun 07 19:53:34.302428 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.302342 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 07 19:53:34.302696 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.302675 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qjqwc\"" Jun 07 19:53:34.304514 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.304495 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 07 19:53:34.305228 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.305210 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx"] Jun 07 19:53:34.377445 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.377419 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld"] Jun 07 19:53:34.380195 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.380178 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.380797 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.380779 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-v27dh"] Jun 07 19:53:34.382802 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.382586 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 07 19:53:34.382802 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.382716 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-gwn7x\"" Jun 07 19:53:34.383226 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.383047 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 07 19:53:34.387454 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.387435 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc"] Jun 07 19:53:34.387574 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.387555 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.389715 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.389698 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 07 19:53:34.389851 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.389833 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 07 19:53:34.390004 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.389987 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:53:34.390105 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.390004 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-m6kmn\"" Jun 07 19:53:34.390305 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.390288 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 07 19:53:34.390429 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.390408 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.391411 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.391390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld"] Jun 07 19:53:34.392726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.392706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 07 19:53:34.392812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.392706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:53:34.392812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.392776 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tgzcp\"" Jun 07 19:53:34.393125 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.393106 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 07 19:53:34.393259 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.393173 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 07 19:53:34.394638 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.394618 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc"] Jun 07 19:53:34.395472 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.395453 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-v27dh"] Jun 07 19:53:34.397634 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.397611 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 07 19:53:34.411257 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.411234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.411341 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.411266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvnk\" (UniqueName: \"kubernetes.io/projected/1935d00b-dfe4-44eb-9bf0-1783184245a0-kube-api-access-zwvnk\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.411341 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.411295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1935d00b-dfe4-44eb-9bf0-1783184245a0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.411422 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.411343 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvkp5\" (UniqueName: \"kubernetes.io/projected/bf6f2475-5407-4bd2-be57-b343d325fe5c-kube-api-access-jvkp5\") pod \"volume-data-source-validator-78dd696465-gmckx\" (UID: \"bf6f2475-5407-4bd2-be57-b343d325fe5c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" Jun 07 19:53:34.476091 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.476066 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79"] Jun 07 19:53:34.479166 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.479134 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.481358 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.481338 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 07 19:53:34.481358 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.481343 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-k82g2\"" Jun 07 19:53:34.481508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.481469 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:53:34.481598 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.481583 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 07 19:53:34.487390 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.487372 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79"] Jun 07 19:53:34.511760 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvkp5\" (UniqueName: \"kubernetes.io/projected/bf6f2475-5407-4bd2-be57-b343d325fe5c-kube-api-access-jvkp5\") pod \"volume-data-source-validator-78dd696465-gmckx\" (UID: \"bf6f2475-5407-4bd2-be57-b343d325fe5c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" Jun 07 19:53:34.511852 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.511852 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511784 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ce8e2e-75ba-40bf-b49c-889d49cc1656-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.511852 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511814 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8872f51c-16e4-4390-abd3-0b392206c9a5-serving-cert\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.512013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6xjf\" (UniqueName: \"kubernetes.io/projected/8872f51c-16e4-4390-abd3-0b392206c9a5-kube-api-access-k6xjf\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.512013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511895 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ce8e2e-75ba-40bf-b49c-889d49cc1656-config\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.512013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511940 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5xr6\" (UniqueName: \"kubernetes.io/projected/81ce8e2e-75ba-40bf-b49c-889d49cc1656-kube-api-access-x5xr6\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.512013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.511989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvnk\" (UniqueName: \"kubernetes.io/projected/1935d00b-dfe4-44eb-9bf0-1783184245a0-kube-api-access-zwvnk\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512042 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8164f07-a9fc-4741-8d46-c054d082b5ac-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512072 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-trusted-ca\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.512089 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1935d00b-dfe4-44eb-9bf0-1783184245a0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.512161 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:35.012128839 +0000 UTC m=+184.594644098 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:34.512243 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512186 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-config\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.512797 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.512776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1935d00b-dfe4-44eb-9bf0-1783184245a0-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.519647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.519623 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvnk\" (UniqueName: \"kubernetes.io/projected/1935d00b-dfe4-44eb-9bf0-1783184245a0-kube-api-access-zwvnk\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:34.519900 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.519880 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvkp5\" (UniqueName: \"kubernetes.io/projected/bf6f2475-5407-4bd2-be57-b343d325fe5c-kube-api-access-jvkp5\") pod \"volume-data-source-validator-78dd696465-gmckx\" (UID: \"bf6f2475-5407-4bd2-be57-b343d325fe5c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" Jun 07 19:53:34.596721 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.596678 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" Jun 07 19:53:34.612739 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612719 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8872f51c-16e4-4390-abd3-0b392206c9a5-serving-cert\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.612830 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6xjf\" (UniqueName: \"kubernetes.io/projected/8872f51c-16e4-4390-abd3-0b392206c9a5-kube-api-access-k6xjf\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.612830 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612765 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.612830 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch88t\" (UniqueName: \"kubernetes.io/projected/cf30e214-4782-4daa-966a-b49896f45190-kube-api-access-ch88t\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.612986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612897 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ce8e2e-75ba-40bf-b49c-889d49cc1656-config\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.612986 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5xr6\" (UniqueName: \"kubernetes.io/projected/81ce8e2e-75ba-40bf-b49c-889d49cc1656-kube-api-access-x5xr6\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.613086 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.612988 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8164f07-a9fc-4741-8d46-c054d082b5ac-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.613086 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-trusted-ca\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.613086 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613062 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-config\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.613264 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.613264 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613137 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ce8e2e-75ba-40bf-b49c-889d49cc1656-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.613376 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.613304 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:34.613376 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.613361 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:53:35.113341552 +0000 UTC m=+184.695856812 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:34.613628 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613598 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/81ce8e2e-75ba-40bf-b49c-889d49cc1656-config\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.613790 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613770 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a8164f07-a9fc-4741-8d46-c054d082b5ac-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:34.613859 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613811 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-config\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.613973 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.613954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8872f51c-16e4-4390-abd3-0b392206c9a5-trusted-ca\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.615233 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.615217 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/81ce8e2e-75ba-40bf-b49c-889d49cc1656-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.615810 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.615797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8872f51c-16e4-4390-abd3-0b392206c9a5-serving-cert\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.621830 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.621807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6xjf\" (UniqueName: \"kubernetes.io/projected/8872f51c-16e4-4390-abd3-0b392206c9a5-kube-api-access-k6xjf\") pod \"console-operator-668fdbf85c-v27dh\" (UID: \"8872f51c-16e4-4390-abd3-0b392206c9a5\") " pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.621987 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.621969 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5xr6\" (UniqueName: \"kubernetes.io/projected/81ce8e2e-75ba-40bf-b49c-889d49cc1656-kube-api-access-x5xr6\") pod \"service-ca-operator-6bc5ff68f5-zrvkc\" (UID: \"81ce8e2e-75ba-40bf-b49c-889d49cc1656\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.700621 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.700596 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:34.705491 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.705473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" Jun 07 19:53:34.712383 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.712354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx"] Jun 07 19:53:34.714477 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.714455 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.714541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.714495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch88t\" (UniqueName: \"kubernetes.io/projected/cf30e214-4782-4daa-966a-b49896f45190-kube-api-access-ch88t\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.714591 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.714580 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 19:53:34.714659 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:34.714647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls podName:cf30e214-4782-4daa-966a-b49896f45190 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:35.214623049 +0000 UTC m=+184.797138308 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-bsr79" (UID: "cf30e214-4782-4daa-966a-b49896f45190") : secret "samples-operator-tls" not found Jun 07 19:53:34.715695 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:53:34.715674 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6f2475_5407_4bd2_be57_b343d325fe5c.slice/crio-c72341f6b1f6e9e9ebf3c5b87ed70b1603663143ab5518fd17502ede56a47079 WatchSource:0}: Error finding container c72341f6b1f6e9e9ebf3c5b87ed70b1603663143ab5518fd17502ede56a47079: Status 404 returned error can't find the container with id c72341f6b1f6e9e9ebf3c5b87ed70b1603663143ab5518fd17502ede56a47079 Jun 07 19:53:34.722259 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.722233 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch88t\" (UniqueName: \"kubernetes.io/projected/cf30e214-4782-4daa-966a-b49896f45190-kube-api-access-ch88t\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:34.831178 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.831131 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-v27dh"] Jun 07 19:53:34.833780 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:53:34.833752 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8872f51c_16e4_4390_abd3_0b392206c9a5.slice/crio-904a6bf91ec795da1a997b5cd990a4d70990d7f67e4d386b16ff7903877f9476 WatchSource:0}: Error finding container 904a6bf91ec795da1a997b5cd990a4d70990d7f67e4d386b16ff7903877f9476: Status 404 returned error can't find the container with id 904a6bf91ec795da1a997b5cd990a4d70990d7f67e4d386b16ff7903877f9476 Jun 07 19:53:34.845316 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:34.845292 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc"] Jun 07 19:53:34.847985 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:53:34.847930 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81ce8e2e_75ba_40bf_b49c_889d49cc1656.slice/crio-925a0ffcbbd0c4714b9adaca3822a7c7f7bd40aee3915fc1cfdfd7d10c438a99 WatchSource:0}: Error finding container 925a0ffcbbd0c4714b9adaca3822a7c7f7bd40aee3915fc1cfdfd7d10c438a99: Status 404 returned error can't find the container with id 925a0ffcbbd0c4714b9adaca3822a7c7f7bd40aee3915fc1cfdfd7d10c438a99 Jun 07 19:53:35.017122 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.017091 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:35.017280 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.017259 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:35.017339 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.017328 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:36.017306675 +0000 UTC m=+185.599821934 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:35.117425 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.117359 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:35.117539 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.117509 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:35.117608 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.117577 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:53:36.117558492 +0000 UTC m=+185.700073753 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:35.217798 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.217776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:35.217894 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.217881 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 19:53:35.217932 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:35.217922 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls podName:cf30e214-4782-4daa-966a-b49896f45190 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:36.217911792 +0000 UTC m=+185.800427050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-bsr79" (UID: "cf30e214-4782-4daa-966a-b49896f45190") : secret "samples-operator-tls" not found Jun 07 19:53:35.462055 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.462014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" event={"ID":"8872f51c-16e4-4390-abd3-0b392206c9a5","Type":"ContainerStarted","Data":"904a6bf91ec795da1a997b5cd990a4d70990d7f67e4d386b16ff7903877f9476"} Jun 07 19:53:35.463865 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.463828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" event={"ID":"bf6f2475-5407-4bd2-be57-b343d325fe5c","Type":"ContainerStarted","Data":"c72341f6b1f6e9e9ebf3c5b87ed70b1603663143ab5518fd17502ede56a47079"} Jun 07 19:53:35.465212 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:35.465186 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" event={"ID":"81ce8e2e-75ba-40bf-b49c-889d49cc1656","Type":"ContainerStarted","Data":"925a0ffcbbd0c4714b9adaca3822a7c7f7bd40aee3915fc1cfdfd7d10c438a99"} Jun 07 19:53:36.025821 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:36.025785 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:36.026037 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.025960 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:36.026037 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.026033 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:38.026010575 +0000 UTC m=+187.608525836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:36.126604 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:36.126570 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:36.126772 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.126745 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:36.126834 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.126825 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:53:38.126802926 +0000 UTC m=+187.709318186 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:36.227529 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:36.227437 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:36.227671 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.227572 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 19:53:36.227671 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:36.227647 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls podName:cf30e214-4782-4daa-966a-b49896f45190 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:38.227624528 +0000 UTC m=+187.810139787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-bsr79" (UID: "cf30e214-4782-4daa-966a-b49896f45190") : secret "samples-operator-tls" not found Jun 07 19:53:36.469732 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:36.469673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" event={"ID":"bf6f2475-5407-4bd2-be57-b343d325fe5c","Type":"ContainerStarted","Data":"5987d382f394ec01f1b0bb9009f861073678b5d2156902ab371425b7a65e6f22"} Jun 07 19:53:36.484258 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:36.484136 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gmckx" podStartSLOduration=1.256798239 podStartE2EDuration="2.484119514s" totalImagesPullingTime="1.227321275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:53:36.483416243 +0000 UTC m=+186.065931525" watchObservedRunningTime="2026-06-07 19:53:36.484119514 +0000 UTC m=+186.066634796" Jun 07 19:53:37.474362 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.474329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/0.log" Jun 07 19:53:37.474758 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.474378 2576 generic.go:356] "Generic (PLEG): container finished" podID="8872f51c-16e4-4390-abd3-0b392206c9a5" containerID="a2048b7d0a94337a20f98cb1fb3a73750efdb587eedaca478763da80e5bb907f" exitCode=255 Jun 07 19:53:37.474758 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.474461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" event={"ID":"8872f51c-16e4-4390-abd3-0b392206c9a5","Type":"ContainerDied","Data":"a2048b7d0a94337a20f98cb1fb3a73750efdb587eedaca478763da80e5bb907f"} Jun 07 19:53:37.474758 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.474749 2576 scope.go:117] "RemoveContainer" containerID="a2048b7d0a94337a20f98cb1fb3a73750efdb587eedaca478763da80e5bb907f" Jun 07 19:53:37.475952 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.475932 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" event={"ID":"81ce8e2e-75ba-40bf-b49c-889d49cc1656","Type":"ContainerStarted","Data":"983fb3c8e33049f717ed9681b3f20ac1663f425a5125e8741679cdea8a187f89"} Jun 07 19:53:37.502811 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:37.502738 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" podStartSLOduration=1.071670511 podStartE2EDuration="3.502726224s" totalImagesPullingTime="2.431055713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:53:37.501990794 +0000 UTC m=+187.084514165" watchObservedRunningTime="2026-06-07 19:53:37.502726224 +0000 UTC m=+187.085241568" Jun 07 19:53:38.040116 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.040087 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:38.040247 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.040206 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:38.040295 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.040259 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:42.040246171 +0000 UTC m=+191.622761430 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:38.141314 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.141268 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:38.141434 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.141415 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:38.141491 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.141480 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:53:42.141460665 +0000 UTC m=+191.723975926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:38.242274 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.242244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:38.242391 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.242374 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 19:53:38.242438 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.242429 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls podName:cf30e214-4782-4daa-966a-b49896f45190 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:42.24241495 +0000 UTC m=+191.824930209 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-bsr79" (UID: "cf30e214-4782-4daa-966a-b49896f45190") : secret "samples-operator-tls" not found Jun 07 19:53:38.480849 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.480827 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 19:53:38.481274 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.481257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/0.log" Jun 07 19:53:38.481321 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.481297 2576 generic.go:356] "Generic (PLEG): container finished" podID="8872f51c-16e4-4390-abd3-0b392206c9a5" containerID="ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b" exitCode=255 Jun 07 19:53:38.481375 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.481360 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" event={"ID":"8872f51c-16e4-4390-abd3-0b392206c9a5","Type":"ContainerDied","Data":"ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b"} Jun 07 19:53:38.481422 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.481410 2576 scope.go:117] "RemoveContainer" containerID="a2048b7d0a94337a20f98cb1fb3a73750efdb587eedaca478763da80e5bb907f" Jun 07 19:53:38.481615 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.481593 2576 scope.go:117] "RemoveContainer" containerID="ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b" Jun 07 19:53:38.481797 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:38.481772 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-v27dh_openshift-console-operator(8872f51c-16e4-4390-abd3-0b392206c9a5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" podUID="8872f51c-16e4-4390-abd3-0b392206c9a5" Jun 07 19:53:38.692882 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.692851 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7"] Jun 07 19:53:38.697249 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.697232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" Jun 07 19:53:38.699837 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.699811 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 07 19:53:38.700063 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.700045 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 07 19:53:38.700163 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.700074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-cbmqs\"" Jun 07 19:53:38.703908 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.703881 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7"] Jun 07 19:53:38.846932 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.846860 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfnlx\" (UniqueName: \"kubernetes.io/projected/4bbd929c-7657-400b-8797-95eaa2c46018-kube-api-access-xfnlx\") pod \"migrator-955ffdf5f-qqzj7\" (UID: \"4bbd929c-7657-400b-8797-95eaa2c46018\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" Jun 07 19:53:38.947761 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.947733 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfnlx\" (UniqueName: \"kubernetes.io/projected/4bbd929c-7657-400b-8797-95eaa2c46018-kube-api-access-xfnlx\") pod \"migrator-955ffdf5f-qqzj7\" (UID: \"4bbd929c-7657-400b-8797-95eaa2c46018\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" Jun 07 19:53:38.955468 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:38.955441 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfnlx\" (UniqueName: \"kubernetes.io/projected/4bbd929c-7657-400b-8797-95eaa2c46018-kube-api-access-xfnlx\") pod \"migrator-955ffdf5f-qqzj7\" (UID: \"4bbd929c-7657-400b-8797-95eaa2c46018\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" Jun 07 19:53:39.005666 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:39.005646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" Jun 07 19:53:39.127859 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:39.127779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7"] Jun 07 19:53:39.131633 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:53:39.131598 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bbd929c_7657_400b_8797_95eaa2c46018.slice/crio-8e0417bbdba328342cd795019de1f051ee0039a5df5e49dfdd1c3f2e115a8146 WatchSource:0}: Error finding container 8e0417bbdba328342cd795019de1f051ee0039a5df5e49dfdd1c3f2e115a8146: Status 404 returned error can't find the container with id 8e0417bbdba328342cd795019de1f051ee0039a5df5e49dfdd1c3f2e115a8146 Jun 07 19:53:39.485454 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:39.485418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" event={"ID":"4bbd929c-7657-400b-8797-95eaa2c46018","Type":"ContainerStarted","Data":"8e0417bbdba328342cd795019de1f051ee0039a5df5e49dfdd1c3f2e115a8146"} Jun 07 19:53:39.487056 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:39.487038 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 19:53:39.487388 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:39.487371 2576 scope.go:117] "RemoveContainer" containerID="ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b" Jun 07 19:53:39.487551 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:39.487531 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-v27dh_openshift-console-operator(8872f51c-16e4-4390-abd3-0b392206c9a5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" podUID="8872f51c-16e4-4390-abd3-0b392206c9a5" Jun 07 19:53:40.089210 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:40.089185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxnq7_02bb1a1e-07bd-4524-bcdb-bb70bf76310d/dns-node-resolver/0.log" Jun 07 19:53:40.491674 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:40.491647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" event={"ID":"4bbd929c-7657-400b-8797-95eaa2c46018","Type":"ContainerStarted","Data":"e8455def994c035c5329f4df1908f14684462e7cd01e1005fb7ae770d3ffb094"} Jun 07 19:53:40.491956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:40.491693 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" event={"ID":"4bbd929c-7657-400b-8797-95eaa2c46018","Type":"ContainerStarted","Data":"f1fff5d81bda6116ff30df90bf9b975d841c410c3c91bcef36b1306945516c88"} Jun 07 19:53:40.505506 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:40.505453 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-qqzj7" podStartSLOduration=1.295393626 podStartE2EDuration="2.505439172s" totalImagesPullingTime="1.210045546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:53:40.505347027 +0000 UTC m=+190.087862310" watchObservedRunningTime="2026-06-07 19:53:40.505439172 +0000 UTC m=+190.087954452" Jun 07 19:53:41.088891 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:41.088866 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vb2md_94da0729-0586-4e21-9689-035efa5efa5e/node-ca/0.log" Jun 07 19:53:41.489947 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:41.489921 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54tzw_0721b842-43b6-42cd-8e69-70da07618f62/serve-healthcheck-canary/0.log" Jun 07 19:53:42.072233 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:42.072192 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:42.072612 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.072307 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:42.072612 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.072375 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:50.072359896 +0000 UTC m=+199.654875155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:42.173136 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:42.173099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:42.173297 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.173238 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:42.173340 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.173305 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:53:50.173290319 +0000 UTC m=+199.755805579 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:42.273983 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:42.273955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:42.274080 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.274067 2576 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 07 19:53:42.274116 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:42.274109 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls podName:cf30e214-4782-4daa-966a-b49896f45190 nodeName:}" failed. No retries permitted until 2026-06-07 19:53:50.274098161 +0000 UTC m=+199.856613420 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-bsr79" (UID: "cf30e214-4782-4daa-966a-b49896f45190") : secret "samples-operator-tls" not found Jun 07 19:53:44.701365 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:44.701320 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:44.701748 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:44.701383 2576 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:53:44.701748 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:44.701690 2576 scope.go:117] "RemoveContainer" containerID="ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b" Jun 07 19:53:44.701867 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:44.701845 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-v27dh_openshift-console-operator(8872f51c-16e4-4390-abd3-0b392206c9a5)\"" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" podUID="8872f51c-16e4-4390-abd3-0b392206c9a5" Jun 07 19:53:50.130003 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.129966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:53:50.130392 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:50.130104 2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:50.130392 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:50.130188 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls podName:1935d00b-dfe4-44eb-9bf0-1783184245a0 nodeName:}" failed. No retries permitted until 2026-06-07 19:54:06.130173022 +0000 UTC m=+215.712688281 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-7kcwx" (UID: "1935d00b-dfe4-44eb-9bf0-1783184245a0") : secret "cluster-monitoring-operator-tls" not found Jun 07 19:53:50.230594 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.230562 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:53:50.230730 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:50.230667 2576 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 07 19:53:50.230730 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:53:50.230717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert podName:a8164f07-a9fc-4741-8d46-c054d082b5ac nodeName:}" failed. No retries permitted until 2026-06-07 19:54:06.230704135 +0000 UTC m=+215.813219393 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-cz6ld" (UID: "a8164f07-a9fc-4741-8d46-c054d082b5ac") : secret "networking-console-plugin-cert" not found Jun 07 19:53:50.331741 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.331696 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:50.334099 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.334071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/cf30e214-4782-4daa-966a-b49896f45190-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-bsr79\" (UID: \"cf30e214-4782-4daa-966a-b49896f45190\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:50.388049 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.387962 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" Jun 07 19:53:50.504960 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:50.504927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79"] Jun 07 19:53:51.523787 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:51.523754 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" event={"ID":"cf30e214-4782-4daa-966a-b49896f45190","Type":"ContainerStarted","Data":"2e8335e674e84bd5434d2e1c1cd6b31ab9713c6115c126b259c5e4edbfe4bcd6"} Jun 07 19:53:52.528486 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:52.528461 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" event={"ID":"cf30e214-4782-4daa-966a-b49896f45190","Type":"ContainerStarted","Data":"0e3752771b07f78a5d268d1f43f52c146d4869a0694efa7a001b9a5ef8de1b35"} Jun 07 19:53:53.533551 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:53.533497 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" event={"ID":"cf30e214-4782-4daa-966a-b49896f45190","Type":"ContainerStarted","Data":"37d57ec1d4d9bca8872c299645eca3eade078433c0a6542897c55ca6a4f44e9d"} Jun 07 19:53:53.548085 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:53.548041 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-bsr79" podStartSLOduration=17.686566605 podStartE2EDuration="19.548027286s" totalImagesPullingTime="1.861460681s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:53:53.547498703 +0000 UTC m=+203.130013996" watchObservedRunningTime="2026-06-07 19:53:53.548027286 +0000 UTC m=+203.130542566" Jun 07 19:53:59.929485 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:53:59.929456 2576 scope.go:117] "RemoveContainer" containerID="ee0bf9d3e2d9b7407e567fe79cf35714b599753c23392c43c7c4c24a0a4d161b" Jun 07 19:54:00.213244 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.213171 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-ms28r"] Jun 07 19:54:00.216629 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.216601 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.221410 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.221383 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 07 19:54:00.222105 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.222087 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 07 19:54:00.223522 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.223506 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2d242\"" Jun 07 19:54:00.224413 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.224397 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 07 19:54:00.224413 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.224405 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 07 19:54:00.249369 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.249349 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ms28r"] Jun 07 19:54:00.300527 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.300496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-data-volume\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.300673 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.300552 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqdrl\" (UniqueName: \"kubernetes.io/projected/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-api-access-vqdrl\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.300673 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.300632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-crio-socket\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.300673 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.300658 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.300775 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.300695 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401625 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401595 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-crio-socket\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401791 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401634 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401791 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401683 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-crio-socket\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401791 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401685 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401791 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401768 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-data-volume\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.401987 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.401909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqdrl\" (UniqueName: \"kubernetes.io/projected/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-api-access-vqdrl\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.402105 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.402085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-data-volume\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.402295 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.402280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.404135 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.404111 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.410328 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.410307 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqdrl\" (UniqueName: \"kubernetes.io/projected/64eb1ef5-7eb4-4637-a505-97e51f62c9d9-kube-api-access-vqdrl\") pod \"insights-runtime-extractor-ms28r\" (UID: \"64eb1ef5-7eb4-4637-a505-97e51f62c9d9\") " pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.525109 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.525045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-ms28r" Jun 07 19:54:00.557288 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.557267 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 19:54:00.557396 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.557337 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" event={"ID":"8872f51c-16e4-4390-abd3-0b392206c9a5","Type":"ContainerStarted","Data":"d1d3f6a40e3579092aa8b79582b22b8f9fc1343c04811dad2af235d70acc875d"} Jun 07 19:54:00.557647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.557599 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:54:00.573051 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.573009 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" podStartSLOduration=24.125970534 podStartE2EDuration="26.572994099s" totalImagesPullingTime="2.447023565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:00.57229213 +0000 UTC m=+210.154807412" watchObservedRunningTime="2026-06-07 19:54:00.572994099 +0000 UTC m=+210.155509379" Jun 07 19:54:00.651207 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:00.651172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-ms28r"] Jun 07 19:54:00.655721 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:00.655695 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64eb1ef5_7eb4_4637_a505_97e51f62c9d9.slice/crio-bcd107f18a74bbb5a64116b375e0f58438bececee29d813d4fb266c9dd34f558 WatchSource:0}: Error finding container bcd107f18a74bbb5a64116b375e0f58438bececee29d813d4fb266c9dd34f558: Status 404 returned error can't find the container with id bcd107f18a74bbb5a64116b375e0f58438bececee29d813d4fb266c9dd34f558 Jun 07 19:54:01.090722 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.090691 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-v27dh" Jun 07 19:54:01.251786 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.251750 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-2t8tl"] Jun 07 19:54:01.255476 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.255456 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:01.257858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.257831 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 07 19:54:01.257966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.257834 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 07 19:54:01.257966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.257834 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-hbgth\"" Jun 07 19:54:01.263205 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.263182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2t8tl"] Jun 07 19:54:01.309064 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.309027 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67t59\" (UniqueName: \"kubernetes.io/projected/8ba106ad-953d-4d91-81ca-48a7cff9da28-kube-api-access-67t59\") pod \"downloads-6657875f97-2t8tl\" (UID: \"8ba106ad-953d-4d91-81ca-48a7cff9da28\") " pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:01.410154 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.410075 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67t59\" (UniqueName: \"kubernetes.io/projected/8ba106ad-953d-4d91-81ca-48a7cff9da28-kube-api-access-67t59\") pod \"downloads-6657875f97-2t8tl\" (UID: \"8ba106ad-953d-4d91-81ca-48a7cff9da28\") " pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:01.417558 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.417534 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67t59\" (UniqueName: \"kubernetes.io/projected/8ba106ad-953d-4d91-81ca-48a7cff9da28-kube-api-access-67t59\") pod \"downloads-6657875f97-2t8tl\" (UID: \"8ba106ad-953d-4d91-81ca-48a7cff9da28\") " pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:01.566040 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.566003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms28r" event={"ID":"64eb1ef5-7eb4-4637-a505-97e51f62c9d9","Type":"ContainerStarted","Data":"e1e47523563886ebd0ab26c483297bc318b3beda78bc62c1c823648e1b402598"} Jun 07 19:54:01.566222 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.566086 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms28r" event={"ID":"64eb1ef5-7eb4-4637-a505-97e51f62c9d9","Type":"ContainerStarted","Data":"bc8ea6aaaadc2a736b416138ba58e6e62eb06cdd85cecd933602d7d4da89a9f8"} Jun 07 19:54:01.566222 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.566105 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms28r" event={"ID":"64eb1ef5-7eb4-4637-a505-97e51f62c9d9","Type":"ContainerStarted","Data":"bcd107f18a74bbb5a64116b375e0f58438bececee29d813d4fb266c9dd34f558"} Jun 07 19:54:01.567355 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.567338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:01.689940 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:01.689898 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-2t8tl"] Jun 07 19:54:01.694064 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:01.694035 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ba106ad_953d_4d91_81ca_48a7cff9da28.slice/crio-e6e693d36cee89fceb8a0a0ef41002309657a6566789c9f36be4954559ee08bc WatchSource:0}: Error finding container e6e693d36cee89fceb8a0a0ef41002309657a6566789c9f36be4954559ee08bc: Status 404 returned error can't find the container with id e6e693d36cee89fceb8a0a0ef41002309657a6566789c9f36be4954559ee08bc Jun 07 19:54:02.572479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:02.572441 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2t8tl" event={"ID":"8ba106ad-953d-4d91-81ca-48a7cff9da28","Type":"ContainerStarted","Data":"e6e693d36cee89fceb8a0a0ef41002309657a6566789c9f36be4954559ee08bc"} Jun 07 19:54:03.579701 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:03.579661 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-ms28r" event={"ID":"64eb1ef5-7eb4-4637-a505-97e51f62c9d9","Type":"ContainerStarted","Data":"9766f18f9852fc4f9761f2d1eef1dbf760edddfb6a8ec31f48a31eab5f0dc2c1"} Jun 07 19:54:03.596650 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:03.596600 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-ms28r" podStartSLOduration=1.303794742 podStartE2EDuration="3.596581546s" totalImagesPullingTime="2.292786804s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 19:54:00 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:03.59624379 +0000 UTC m=+213.178759071" watchObservedRunningTime="2026-06-07 19:54:03.596581546 +0000 UTC m=+213.179096828" Jun 07 19:54:06.152800 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.152760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:54:06.155314 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.155284 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1935d00b-dfe4-44eb-9bf0-1783184245a0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-7kcwx\" (UID: \"1935d00b-dfe4-44eb-9bf0-1783184245a0\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:54:06.253198 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.253162 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:54:06.255870 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.255842 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a8164f07-a9fc-4741-8d46-c054d082b5ac-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-cz6ld\" (UID: \"a8164f07-a9fc-4741-8d46-c054d082b5ac\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:54:06.401939 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.401910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" Jun 07 19:54:06.491948 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.491920 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" Jun 07 19:54:06.610101 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.610068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx"] Jun 07 19:54:06.614250 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:06.614219 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1935d00b_dfe4_44eb_9bf0_1783184245a0.slice/crio-581b08e95a77655e9ab821755be9643cc9fd5c328f97928acfec8447d25b5f0d WatchSource:0}: Error finding container 581b08e95a77655e9ab821755be9643cc9fd5c328f97928acfec8447d25b5f0d: Status 404 returned error can't find the container with id 581b08e95a77655e9ab821755be9643cc9fd5c328f97928acfec8447d25b5f0d Jun 07 19:54:06.650011 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:06.649878 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld"] Jun 07 19:54:06.652773 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:06.652731 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8164f07_a9fc_4741_8d46_c054d082b5ac.slice/crio-0690e82360b88ae20332acd079e0768d6df26e70975ac96b085c5c43874bf662 WatchSource:0}: Error finding container 0690e82360b88ae20332acd079e0768d6df26e70975ac96b085c5c43874bf662: Status 404 returned error can't find the container with id 0690e82360b88ae20332acd079e0768d6df26e70975ac96b085c5c43874bf662 Jun 07 19:54:07.596988 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:07.596923 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" event={"ID":"a8164f07-a9fc-4741-8d46-c054d082b5ac","Type":"ContainerStarted","Data":"0690e82360b88ae20332acd079e0768d6df26e70975ac96b085c5c43874bf662"} Jun 07 19:54:07.598358 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:07.598307 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" event={"ID":"1935d00b-dfe4-44eb-9bf0-1783184245a0","Type":"ContainerStarted","Data":"581b08e95a77655e9ab821755be9643cc9fd5c328f97928acfec8447d25b5f0d"} Jun 07 19:54:08.604698 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:08.604656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" event={"ID":"a8164f07-a9fc-4741-8d46-c054d082b5ac","Type":"ContainerStarted","Data":"acfa0ba1b4680720e1e7f62ee52ff2cb7ef6aa3adfda5d93403ed34cd2c8e218"} Jun 07 19:54:08.619631 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:08.619481 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-cz6ld" podStartSLOduration=33.292320366 podStartE2EDuration="34.619458882s" totalImagesPullingTime="1.327138516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:08.618458794 +0000 UTC m=+218.200974079" watchObservedRunningTime="2026-06-07 19:54:08.619458882 +0000 UTC m=+218.201974169" Jun 07 19:54:09.310834 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.310802 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd"] Jun 07 19:54:09.313415 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.313392 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:09.315776 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.315618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 07 19:54:09.315776 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.315674 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-pk2t7\"" Jun 07 19:54:09.322414 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.322393 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd"] Jun 07 19:54:09.380505 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.380477 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb7e911-7b31-4930-b50f-d045fe547e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-whlxd\" (UID: \"7eb7e911-7b31-4930-b50f-d045fe547e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:09.481317 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.481281 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb7e911-7b31-4930-b50f-d045fe547e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-whlxd\" (UID: \"7eb7e911-7b31-4930-b50f-d045fe547e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:09.484114 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.484085 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/7eb7e911-7b31-4930-b50f-d045fe547e34-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-whlxd\" (UID: \"7eb7e911-7b31-4930-b50f-d045fe547e34\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:09.611009 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.610916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" event={"ID":"1935d00b-dfe4-44eb-9bf0-1783184245a0","Type":"ContainerStarted","Data":"f2c9cec61c0eab6bef2099f16554beb9b2a836996c62bb0d9505f4506e7e1485"} Jun 07 19:54:09.625870 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.625841 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:09.626011 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.625900 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-7kcwx" podStartSLOduration=33.401952306 podStartE2EDuration="35.625884562s" totalImagesPullingTime="2.223932256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:53:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:09.624316737 +0000 UTC m=+219.206832019" watchObservedRunningTime="2026-06-07 19:54:09.625884562 +0000 UTC m=+219.208399847" Jun 07 19:54:09.767004 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:09.766932 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd"] Jun 07 19:54:09.770159 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:09.770103 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb7e911_7b31_4930_b50f_d045fe547e34.slice/crio-204a44f1e281409b63656c31cf0eda80fec77bf69a9d76833139f2f64456298f WatchSource:0}: Error finding container 204a44f1e281409b63656c31cf0eda80fec77bf69a9d76833139f2f64456298f: Status 404 returned error can't find the container with id 204a44f1e281409b63656c31cf0eda80fec77bf69a9d76833139f2f64456298f Jun 07 19:54:10.579734 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.579706 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:54:10.582453 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.582429 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585817 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585829 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585839 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585879 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 07 19:54:10.585974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.585964 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jdkpw\"" Jun 07 19:54:10.592408 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.592384 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:54:10.615817 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.615788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" event={"ID":"7eb7e911-7b31-4930-b50f-d045fe547e34","Type":"ContainerStarted","Data":"204a44f1e281409b63656c31cf0eda80fec77bf69a9d76833139f2f64456298f"} Jun 07 19:54:10.691891 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.691811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.691891 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.691885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.692098 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.691987 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzj57\" (UniqueName: \"kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.692098 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.692088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.692231 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.692174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.692288 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.692243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793352 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzj57\" (UniqueName: \"kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793426 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793449 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793498 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.793733 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.793553 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.794092 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.794046 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.794595 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.794518 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.794595 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.794523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.796550 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.796525 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.796657 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.796629 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.802383 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.802359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzj57\" (UniqueName: \"kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57\") pod \"console-66dc5bcc46-gfkbh\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:10.894132 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:10.894055 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:12.962896 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:12.962860 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:54:12.966399 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:12.966379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:12.974410 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:12.974371 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 07 19:54:12.976235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:12.976207 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:54:13.010027 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.009998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010053 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010102 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hkwx\" (UniqueName: \"kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010253 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.010318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.010282 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111275 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111312 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hkwx\" (UniqueName: \"kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111540 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111354 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111540 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111394 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111540 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111434 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111540 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.111540 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.111531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.112377 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.112240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.112377 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.112240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.112377 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.112360 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.112606 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.112497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.114414 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.114394 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.114566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.114535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.119020 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.119000 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hkwx\" (UniqueName: \"kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx\") pod \"console-756bb885c4-4fwlx\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:13.279317 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:13.279244 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:18.099440 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.099412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:54:18.103253 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:18.103224 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd2348c3_25da_47ba_b15c_1fc1d4a50d33.slice/crio-c66e91f0dae8008156bb0a78b20814e0795ef4bf54123374fa9a1a3bdb9fadb4 WatchSource:0}: Error finding container c66e91f0dae8008156bb0a78b20814e0795ef4bf54123374fa9a1a3bdb9fadb4: Status 404 returned error can't find the container with id c66e91f0dae8008156bb0a78b20814e0795ef4bf54123374fa9a1a3bdb9fadb4 Jun 07 19:54:18.117313 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.117288 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:54:18.121539 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:18.121500 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44619c4d_15ab_4ab4_be4b_f48485d84d84.slice/crio-909b9b0caedfd7527def0d7a29d5a2586b71c23af27df76415777d718a340a93 WatchSource:0}: Error finding container 909b9b0caedfd7527def0d7a29d5a2586b71c23af27df76415777d718a340a93: Status 404 returned error can't find the container with id 909b9b0caedfd7527def0d7a29d5a2586b71c23af27df76415777d718a340a93 Jun 07 19:54:18.650068 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.649995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc5bcc46-gfkbh" event={"ID":"44619c4d-15ab-4ab4-be4b-f48485d84d84","Type":"ContainerStarted","Data":"909b9b0caedfd7527def0d7a29d5a2586b71c23af27df76415777d718a340a93"} Jun 07 19:54:18.656002 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.655700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" event={"ID":"7eb7e911-7b31-4930-b50f-d045fe547e34","Type":"ContainerStarted","Data":"984a6e4c9c276c000c6fc40ce3b6669933153849d0aab4bfa1f07afb3ec6cc5b"} Jun 07 19:54:18.656002 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.655756 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:18.660284 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.660222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756bb885c4-4fwlx" event={"ID":"cd2348c3-25da-47ba-b15c-1fc1d4a50d33","Type":"ContainerStarted","Data":"c66e91f0dae8008156bb0a78b20814e0795ef4bf54123374fa9a1a3bdb9fadb4"} Jun 07 19:54:18.664164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.662619 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-2t8tl" event={"ID":"8ba106ad-953d-4d91-81ca-48a7cff9da28","Type":"ContainerStarted","Data":"956e19256119880c8c3847b69a6210ad485f8fdc1e9eb358da17a56385b3cc0e"} Jun 07 19:54:18.664164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.664072 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:18.664925 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.664421 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" Jun 07 19:54:18.672001 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.671841 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-whlxd" podStartSLOduration=1.484279278 podStartE2EDuration="9.671822772s" totalImagesPullingTime="8.187543494s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:18.670294295 +0000 UTC m=+228.252809577" watchObservedRunningTime="2026-06-07 19:54:18.671822772 +0000 UTC m=+228.254338035" Jun 07 19:54:18.676870 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.676845 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-2t8tl" Jun 07 19:54:18.686982 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:18.686570 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-2t8tl" podStartSLOduration=1.363814711 podStartE2EDuration="17.686550845s" totalImagesPullingTime="16.322736134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:18.686103623 +0000 UTC m=+228.268618906" watchObservedRunningTime="2026-06-07 19:54:18.686550845 +0000 UTC m=+228.269066126" Jun 07 19:54:22.681966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:22.681918 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc5bcc46-gfkbh" event={"ID":"44619c4d-15ab-4ab4-be4b-f48485d84d84","Type":"ContainerStarted","Data":"b2bce0bc989c35d175976fda02eac595bb4636de770ca7ea17a249e8cb12c569"} Jun 07 19:54:22.683669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:22.683642 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756bb885c4-4fwlx" event={"ID":"cd2348c3-25da-47ba-b15c-1fc1d4a50d33","Type":"ContainerStarted","Data":"d22cb86d45e4c57650f7a1aac7813561ea75dd2f2927e35c77c55ce662dd3de2"} Jun 07 19:54:22.697521 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:22.697467 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66dc5bcc46-gfkbh" podStartSLOduration=8.551860569 podStartE2EDuration="12.697450036s" totalImagesPullingTime="4.145589467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:22.696972529 +0000 UTC m=+232.279487813" watchObservedRunningTime="2026-06-07 19:54:22.697450036 +0000 UTC m=+232.279965316" Jun 07 19:54:22.713414 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:22.713369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-756bb885c4-4fwlx" podStartSLOduration=6.542618813 podStartE2EDuration="10.713355487s" totalImagesPullingTime="4.170736674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:22.711991836 +0000 UTC m=+232.294507124" watchObservedRunningTime="2026-06-07 19:54:22.713355487 +0000 UTC m=+232.295870767" Jun 07 19:54:23.279738 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.279699 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:23.280030 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.279774 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:54:23.281157 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.281112 2576 patch_prober.go:28] interesting pod/console-756bb885c4-4fwlx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 19:54:23.281301 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.281188 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-756bb885c4-4fwlx" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 19:54:23.695942 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.695908 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9"] Jun 07 19:54:23.732855 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.732825 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx"] Jun 07 19:54:23.733019 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.732943 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.735510 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.735474 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 07 19:54:23.735660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.735558 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-shjcw\"" Jun 07 19:54:23.735660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.735473 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 07 19:54:23.735660 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.735637 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 07 19:54:23.750447 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.750423 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9"] Jun 07 19:54:23.750556 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.750470 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pppwh"] Jun 07 19:54:23.750556 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.750542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.752753 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.752731 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 07 19:54:23.752936 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.752916 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 07 19:54:23.753362 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.753196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-db87f\"" Jun 07 19:54:23.753362 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.753204 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 07 19:54:23.776984 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.776963 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx"] Jun 07 19:54:23.777100 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.777091 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.779320 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.779298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 07 19:54:23.779427 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.779304 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w8qc6\"" Jun 07 19:54:23.779560 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.779542 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 07 19:54:23.779653 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.779632 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 07 19:54:23.815734 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.815586 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.815734 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.815668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e50319d-9444-41fb-8d9b-7edeec56ea47-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.815918 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.815848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9ljl\" (UniqueName: \"kubernetes.io/projected/3e50319d-9444-41fb-8d9b-7edeec56ea47-kube-api-access-f9ljl\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.815971 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.815913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.917108 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917067 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917297 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917180 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917297 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-accelerators-collector-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.917297 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917297 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-root\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.917516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917379 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwq89\" (UniqueName: \"kubernetes.io/projected/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-kube-api-access-lwq89\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.917516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917424 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwm4n\" (UniqueName: \"kubernetes.io/projected/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-api-access-hwm4n\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917465 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.917516 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-metrics-client-ca\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.917740 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e50319d-9444-41fb-8d9b-7edeec56ea47-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.917740 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:54:23.917588 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 07 19:54:23.917740 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917612 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8b0501-59ed-44e8-a39c-7f5384e3c289-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:23.917740 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-sys\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.917740 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:54:23.917726 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls podName:3e50319d-9444-41fb-8d9b-7edeec56ea47 nodeName:}" failed. No retries permitted until 2026-06-07 19:54:24.417703089 +0000 UTC m=+234.000218349 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-pqbh9" (UID: "3e50319d-9444-41fb-8d9b-7edeec56ea47") : secret "openshift-state-metrics-tls" not found Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-textfile\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917800 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-tls\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917858 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9ljl\" (UniqueName: \"kubernetes.io/projected/3e50319d-9444-41fb-8d9b-7edeec56ea47-kube-api-access-f9ljl\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917892 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-wtmp\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917921 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:23.918008 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.917954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.918422 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.918378 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e50319d-9444-41fb-8d9b-7edeec56ea47-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.920689 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.920669 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:23.928657 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:23.928625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9ljl\" (UniqueName: \"kubernetes.io/projected/3e50319d-9444-41fb-8d9b-7edeec56ea47-kube-api-access-f9ljl\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:24.018711 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018631 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-metrics-client-ca\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.018872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8b0501-59ed-44e8-a39c-7f5384e3c289-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.018872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-sys\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.018872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018776 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-textfile\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.018872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018802 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-tls\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019097 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.018881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-sys\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019097 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-wtmp\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019097 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019104 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-accelerators-collector-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019239 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-textfile\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019287 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019299 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/bd8b0501-59ed-44e8-a39c-7f5384e3c289-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019331 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-root\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019342 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-metrics-client-ca\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwq89\" (UniqueName: \"kubernetes.io/projected/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-kube-api-access-lwq89\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019412 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwm4n\" (UniqueName: \"kubernetes.io/projected/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-api-access-hwm4n\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.019500 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019438 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-wtmp\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.020062 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019912 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.020062 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.019979 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-root\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.020492 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.020353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-accelerators-collector-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.020903 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.020881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bd8b0501-59ed-44e8-a39c-7f5384e3c289-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.022460 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.022417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.022460 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.022443 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.022460 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.022450 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-tls\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.022706 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.022482 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.026913 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.026890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwm4n\" (UniqueName: \"kubernetes.io/projected/bd8b0501-59ed-44e8-a39c-7f5384e3c289-kube-api-access-hwm4n\") pod \"kube-state-metrics-57bbf8bfb5-w6fbx\" (UID: \"bd8b0501-59ed-44e8-a39c-7f5384e3c289\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.027045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.027021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwq89\" (UniqueName: \"kubernetes.io/projected/7dfc1f88-558a-4ed2-9141-b9437f9fbe53-kube-api-access-lwq89\") pod \"node-exporter-pppwh\" (UID: \"7dfc1f88-558a-4ed2-9141-b9437f9fbe53\") " pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.061226 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.061203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" Jun 07 19:54:24.087357 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.087333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pppwh" Jun 07 19:54:24.125996 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:24.125964 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dfc1f88_558a_4ed2_9141_b9437f9fbe53.slice/crio-0ea9538052aa5457b28aa46ffa80d4ecd56c421283a0923308bd48bb89ab5f31 WatchSource:0}: Error finding container 0ea9538052aa5457b28aa46ffa80d4ecd56c421283a0923308bd48bb89ab5f31: Status 404 returned error can't find the container with id 0ea9538052aa5457b28aa46ffa80d4ecd56c421283a0923308bd48bb89ab5f31 Jun 07 19:54:24.262640 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.262597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx"] Jun 07 19:54:24.265781 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:24.265749 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd8b0501_59ed_44e8_a39c_7f5384e3c289.slice/crio-8e892248be12322b6eab87d806f6a93aec480c4b893c2ed266572be44ee401ec WatchSource:0}: Error finding container 8e892248be12322b6eab87d806f6a93aec480c4b893c2ed266572be44ee401ec: Status 404 returned error can't find the container with id 8e892248be12322b6eab87d806f6a93aec480c4b893c2ed266572be44ee401ec Jun 07 19:54:24.424349 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.424302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:24.427028 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.426997 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e50319d-9444-41fb-8d9b-7edeec56ea47-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-pqbh9\" (UID: \"3e50319d-9444-41fb-8d9b-7edeec56ea47\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:24.644552 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.644464 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" Jun 07 19:54:24.698619 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.698578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pppwh" event={"ID":"7dfc1f88-558a-4ed2-9141-b9437f9fbe53","Type":"ContainerStarted","Data":"0ea9538052aa5457b28aa46ffa80d4ecd56c421283a0923308bd48bb89ab5f31"} Jun 07 19:54:24.701967 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.701584 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" event={"ID":"bd8b0501-59ed-44e8-a39c-7f5384e3c289","Type":"ContainerStarted","Data":"8e892248be12322b6eab87d806f6a93aec480c4b893c2ed266572be44ee401ec"} Jun 07 19:54:24.850764 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:24.850725 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9"] Jun 07 19:54:24.859030 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:24.858992 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e50319d_9444_41fb_8d9b_7edeec56ea47.slice/crio-ed75b52fdcb45b343f466bfe750cb8e544d9b196091d04bf8141956cbb560603 WatchSource:0}: Error finding container ed75b52fdcb45b343f466bfe750cb8e544d9b196091d04bf8141956cbb560603: Status 404 returned error can't find the container with id ed75b52fdcb45b343f466bfe750cb8e544d9b196091d04bf8141956cbb560603 Jun 07 19:54:25.709312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:25.709170 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" event={"ID":"3e50319d-9444-41fb-8d9b-7edeec56ea47","Type":"ContainerStarted","Data":"912bd225653cd765cea32a5246f034726785a365ca271dcd3973047297abbde4"} Jun 07 19:54:25.709312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:25.709247 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" event={"ID":"3e50319d-9444-41fb-8d9b-7edeec56ea47","Type":"ContainerStarted","Data":"cc3c6b2fce66f5a18a85a9a14636bd82b6a53fd4e02958515f6edea036db0048"} Jun 07 19:54:25.709312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:25.709280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" event={"ID":"3e50319d-9444-41fb-8d9b-7edeec56ea47","Type":"ContainerStarted","Data":"ed75b52fdcb45b343f466bfe750cb8e544d9b196091d04bf8141956cbb560603"} Jun 07 19:54:26.719974 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:26.719908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pppwh" event={"ID":"7dfc1f88-558a-4ed2-9141-b9437f9fbe53","Type":"ContainerStarted","Data":"46899d0cac3697e3d8c0717ee78c90b8e74fbd8c01e98955d3f71aff6136640b"} Jun 07 19:54:26.723814 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:26.723377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" event={"ID":"bd8b0501-59ed-44e8-a39c-7f5384e3c289","Type":"ContainerStarted","Data":"c36a7be86a6a040eb60f9524fda2e4ee07eb4d685a2f55fc19ee1f641797214d"} Jun 07 19:54:27.728363 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.728327 2576 generic.go:356] "Generic (PLEG): container finished" podID="7dfc1f88-558a-4ed2-9141-b9437f9fbe53" containerID="46899d0cac3697e3d8c0717ee78c90b8e74fbd8c01e98955d3f71aff6136640b" exitCode=0 Jun 07 19:54:27.728802 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.728393 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pppwh" event={"ID":"7dfc1f88-558a-4ed2-9141-b9437f9fbe53","Type":"ContainerDied","Data":"46899d0cac3697e3d8c0717ee78c90b8e74fbd8c01e98955d3f71aff6136640b"} Jun 07 19:54:27.730520 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.730489 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" event={"ID":"bd8b0501-59ed-44e8-a39c-7f5384e3c289","Type":"ContainerStarted","Data":"4d93b54fb821d5e3c266e993037274a832f0cc2d303e7da157d54e56934fda5e"} Jun 07 19:54:27.730639 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.730551 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" event={"ID":"bd8b0501-59ed-44e8-a39c-7f5384e3c289","Type":"ContainerStarted","Data":"1356d4e1bfe8b89dcfb17d8c5e63a53df771fe2fddfe2bd406a2097f038ba4d8"} Jun 07 19:54:27.732637 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.732617 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" event={"ID":"3e50319d-9444-41fb-8d9b-7edeec56ea47","Type":"ContainerStarted","Data":"6e1e086cd1f49acf3f0c7f3e23c1dd7c1563f191b3132f82b9579dd39010f42a"} Jun 07 19:54:27.764200 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.764163 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-w6fbx" podStartSLOduration=2.570903184 podStartE2EDuration="4.764132978s" totalImagesPullingTime="2.193229794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:27.762338678 +0000 UTC m=+237.344853959" watchObservedRunningTime="2026-06-07 19:54:27.764132978 +0000 UTC m=+237.346648258" Jun 07 19:54:27.777971 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:27.777933 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-pqbh9" podStartSLOduration=2.868855722 podStartE2EDuration="4.777921674s" totalImagesPullingTime="1.909065952s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:27.777091287 +0000 UTC m=+237.359606569" watchObservedRunningTime="2026-06-07 19:54:27.777921674 +0000 UTC m=+237.360436955" Jun 07 19:54:28.479768 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.479736 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7djwv"] Jun 07 19:54:28.500942 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.500912 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:54:28.501088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.500953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7djwv"] Jun 07 19:54:28.501088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.501035 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.503253 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.503228 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 07 19:54:28.503253 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.503234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-bw5gn\"" Jun 07 19:54:28.665683 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.665656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x49wc\" (UniqueName: \"kubernetes.io/projected/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-kube-api-access-x49wc\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.665935 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.665915 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.739010 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.738937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pppwh" event={"ID":"7dfc1f88-558a-4ed2-9141-b9437f9fbe53","Type":"ContainerStarted","Data":"739f53e1a787a922b4ac984808fb20456b5c8b0d05481c027cbd0e74a1c08015"} Jun 07 19:54:28.739010 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.738995 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pppwh" event={"ID":"7dfc1f88-558a-4ed2-9141-b9437f9fbe53","Type":"ContainerStarted","Data":"878f73d22ca7731ca2ea369b96fe2cbc2e1601f99b7584220d719a4f60b181a2"} Jun 07 19:54:28.759922 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.759880 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pppwh" podStartSLOduration=3.303790685 podStartE2EDuration="5.759867675s" totalImagesPullingTime="2.329360485s" totalInitContainerRuntime="126.716505ms" isStatefulPod=true podCreationTimestamp="2026-06-07 19:54:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:28.759110915 +0000 UTC m=+238.341626195" watchObservedRunningTime="2026-06-07 19:54:28.759867675 +0000 UTC m=+238.342382955" Jun 07 19:54:28.766362 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.766337 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.766451 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.766435 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x49wc\" (UniqueName: \"kubernetes.io/projected/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-kube-api-access-x49wc\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.768688 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.768665 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.773548 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.773504 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x49wc\" (UniqueName: \"kubernetes.io/projected/d2414fba-cdb1-4721-8ea5-4c1d831ecbc1-kube-api-access-x49wc\") pod \"monitoring-plugin-76b68cc874-7djwv\" (UID: \"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.810362 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.810336 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:28.877497 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.876695 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j"] Jun 07 19:54:28.912221 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.912195 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j"] Jun 07 19:54:28.912356 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.912325 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:28.915510 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915441 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 07 19:54:28.915647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915543 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 07 19:54:28.915647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915551 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-pwnnk\"" Jun 07 19:54:28.915647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915625 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 07 19:54:28.915855 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915687 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 07 19:54:28.915855 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.915830 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 07 19:54:28.920235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.920203 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 07 19:54:28.957823 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:28.957802 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-7djwv"] Jun 07 19:54:28.960083 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:28.960060 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2414fba_cdb1_4721_8ea5_4c1d831ecbc1.slice/crio-d3f51599d15ce8724b8091f46f026ef34ff95ca553c2ac17544175e1a4c226b3 WatchSource:0}: Error finding container d3f51599d15ce8724b8091f46f026ef34ff95ca553c2ac17544175e1a4c226b3: Status 404 returned error can't find the container with id d3f51599d15ce8724b8091f46f026ef34ff95ca553c2ac17544175e1a4c226b3 Jun 07 19:54:29.069627 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069569 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-federate-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069627 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069614 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-serving-certs-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069633 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069746 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069719 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnv6\" (UniqueName: \"kubernetes.io/projected/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-kube-api-access-slnv6\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069750 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-metrics-client-ca\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069790 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.069872 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.069846 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170351 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170327 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnv6\" (UniqueName: \"kubernetes.io/projected/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-kube-api-access-slnv6\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170441 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-metrics-client-ca\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170441 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170381 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170441 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170398 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170559 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170609 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170565 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-federate-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170661 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-serving-certs-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.170661 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.170629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.171174 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.171132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-metrics-client-ca\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.171331 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.171256 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-serving-certs-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.171564 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.171540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-trusted-ca-bundle\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.172849 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.172828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.172965 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.172947 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-secret-telemeter-client\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.173340 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.173321 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-telemeter-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.173385 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.173337 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-federate-client-tls\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.177669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.177651 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnv6\" (UniqueName: \"kubernetes.io/projected/8b2c149b-de7a-4541-92c3-fe6d2727cfe4-kube-api-access-slnv6\") pod \"telemeter-client-75b6bb44f8-z2r8j\" (UID: \"8b2c149b-de7a-4541-92c3-fe6d2727cfe4\") " pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.224623 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.224585 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" Jun 07 19:54:29.388739 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.388717 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j"] Jun 07 19:54:29.389528 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:29.389502 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b2c149b_de7a_4541_92c3_fe6d2727cfe4.slice/crio-609f40ae6d2b8f09b6f9e1c14459e1e8041c990fade4090919d9164cc67736d6 WatchSource:0}: Error finding container 609f40ae6d2b8f09b6f9e1c14459e1e8041c990fade4090919d9164cc67736d6: Status 404 returned error can't find the container with id 609f40ae6d2b8f09b6f9e1c14459e1e8041c990fade4090919d9164cc67736d6 Jun 07 19:54:29.746164 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.746069 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" event={"ID":"8b2c149b-de7a-4541-92c3-fe6d2727cfe4","Type":"ContainerStarted","Data":"609f40ae6d2b8f09b6f9e1c14459e1e8041c990fade4090919d9164cc67736d6"} Jun 07 19:54:29.747743 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.747694 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" event={"ID":"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1","Type":"ContainerStarted","Data":"d3f51599d15ce8724b8091f46f026ef34ff95ca553c2ac17544175e1a4c226b3"} Jun 07 19:54:29.902069 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.902038 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:54:29.927045 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.927011 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:54:29.927216 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.927136 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:29.929709 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929687 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 07 19:54:29.929819 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929787 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 07 19:54:29.929819 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 07 19:54:29.929819 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929800 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d866r\"" Jun 07 19:54:29.929960 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929815 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-antai967ul78j\"" Jun 07 19:54:29.930009 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929984 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 07 19:54:29.930009 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.929991 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 07 19:54:29.930100 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.930085 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 07 19:54:29.930708 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.930688 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 07 19:54:29.930883 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.930864 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 07 19:54:29.931112 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.931017 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 07 19:54:29.931112 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.931032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 07 19:54:29.931112 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.931060 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 07 19:54:29.931112 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.931093 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 07 19:54:29.931374 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.931345 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 07 19:54:29.934108 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.934082 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 07 19:54:29.935614 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:29.935594 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 07 19:54:30.080002 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.079926 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080002 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.079971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080056 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080112 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080158 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080185 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080378 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080378 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080258 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080378 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080378 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080429 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4lhj\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080529 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080557 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080861 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080578 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080861 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080595 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080861 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.080861 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.080660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.181891 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.181859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.182060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.181899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.182060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.181925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.182060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.181960 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.182060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.181997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.182060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182119 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182161 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.182986 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183043 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4lhj\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183260 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.183783 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.183767 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.185170 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.185038 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.187214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.185715 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.187214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.186310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.187214 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.186900 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.188833 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.187643 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.188833 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.188242 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.188833 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.188630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.189526 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.189477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.190188 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.189796 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.190188 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.190155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.190782 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.190738 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.191320 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.191297 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.191919 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.191700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.191919 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.191823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.192064 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.192023 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.193585 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.193489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.195681 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.195639 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4lhj\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj\") pod \"prometheus-k8s-0\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.239123 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.239096 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:30.579686 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.579656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:54:30.582682 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:30.582654 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48768713_eedc_4692_b6e2_78f292ce294e.slice/crio-44ed03c7f46628930a19a353b6576b64f26043add26ab4cf8e6c3ee0a282ec57 WatchSource:0}: Error finding container 44ed03c7f46628930a19a353b6576b64f26043add26ab4cf8e6c3ee0a282ec57: Status 404 returned error can't find the container with id 44ed03c7f46628930a19a353b6576b64f26043add26ab4cf8e6c3ee0a282ec57 Jun 07 19:54:30.752727 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.752655 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"44ed03c7f46628930a19a353b6576b64f26043add26ab4cf8e6c3ee0a282ec57"} Jun 07 19:54:30.894573 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:30.894550 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:54:31.760014 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:31.759979 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" event={"ID":"d2414fba-cdb1-4721-8ea5-4c1d831ecbc1","Type":"ContainerStarted","Data":"741ed00aa72e408c73542ab3c0df1065ac1ae0670503f1dae034535ca716da25"} Jun 07 19:54:31.760420 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:31.760175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:31.764701 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:31.764679 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" Jun 07 19:54:31.774311 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:31.774270 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-7djwv" podStartSLOduration=1.9348537270000001 podStartE2EDuration="3.774255004s" totalImagesPullingTime="1.839401277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:31.773564418 +0000 UTC m=+241.356079693" watchObservedRunningTime="2026-06-07 19:54:31.774255004 +0000 UTC m=+241.356770286" Jun 07 19:54:32.767975 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:32.767946 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" exitCode=0 Jun 07 19:54:32.768354 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:32.768025 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} Jun 07 19:54:32.769531 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:32.769510 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" event={"ID":"8b2c149b-de7a-4541-92c3-fe6d2727cfe4","Type":"ContainerStarted","Data":"6abdf7f457ee3313977e9dead9f260541679d501a98c024f221f6dbf6793cfb2"} Jun 07 19:54:33.279800 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.279772 2576 patch_prober.go:28] interesting pod/console-756bb885c4-4fwlx container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 07 19:54:33.279935 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.279815 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-756bb885c4-4fwlx" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 07 19:54:33.776413 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.776372 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" event={"ID":"8b2c149b-de7a-4541-92c3-fe6d2727cfe4","Type":"ContainerStarted","Data":"2322cbd769f71cebba02b02d0819f61dd0b978632a2bbbdcf0a8955fc8ad56da"} Jun 07 19:54:33.776832 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.776445 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" event={"ID":"8b2c149b-de7a-4541-92c3-fe6d2727cfe4","Type":"ContainerStarted","Data":"e3a1b2fbc87be706330b3220ffdc0aa29f1e34173f73006f246862322b333672"} Jun 07 19:54:33.797905 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.797858 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-75b6bb44f8-z2r8j" podStartSLOduration=2.520459415 podStartE2EDuration="5.797841968s" totalImagesPullingTime="3.277382553s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:33.795199498 +0000 UTC m=+243.377714791" watchObservedRunningTime="2026-06-07 19:54:33.797841968 +0000 UTC m=+243.380357249" Jun 07 19:54:33.876184 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:33.876137 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:54:36.789883 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:36.789847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} Jun 07 19:54:36.790291 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:36.789913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} Jun 07 19:54:39.804003 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:39.803969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} Jun 07 19:54:39.804518 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:39.804040 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} Jun 07 19:54:39.804518 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:39.804078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} Jun 07 19:54:39.804518 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:39.804125 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerStarted","Data":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} Jun 07 19:54:39.837317 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:39.837271 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.0931294559999998 podStartE2EDuration="10.837255856s" totalImagesPullingTime="7.713902496s" totalInitContainerRuntime="30.223904ms" isStatefulPod=false podCreationTimestamp="2026-06-07 19:54:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:39.834492177 +0000 UTC m=+249.417007470" watchObservedRunningTime="2026-06-07 19:54:39.837255856 +0000 UTC m=+249.419771136" Jun 07 19:54:40.239982 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:40.239955 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:54:42.685326 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:42.685294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:54:42.687567 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:42.687548 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/77d8a841-c2b4-47d3-a245-a0f0e4c9fc16-metrics-certs\") pod \"network-metrics-daemon-npn6t\" (UID: \"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16\") " pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:54:42.735708 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:42.735685 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n2jtp\"" Jun 07 19:54:42.744464 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:42.744445 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-npn6t" Jun 07 19:54:42.906992 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:42.906966 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-npn6t"] Jun 07 19:54:42.908980 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:54:42.908953 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77d8a841_c2b4_47d3_a245_a0f0e4c9fc16.slice/crio-0354bbba6961fe3ee9a085829ed09424a364fda56ab704e884ed6b23709f1dd8 WatchSource:0}: Error finding container 0354bbba6961fe3ee9a085829ed09424a364fda56ab704e884ed6b23709f1dd8: Status 404 returned error can't find the container with id 0354bbba6961fe3ee9a085829ed09424a364fda56ab704e884ed6b23709f1dd8 Jun 07 19:54:43.821393 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:43.821363 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn6t" event={"ID":"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16","Type":"ContainerStarted","Data":"0354bbba6961fe3ee9a085829ed09424a364fda56ab704e884ed6b23709f1dd8"} Jun 07 19:54:44.827185 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.827016 2576 generic.go:356] "Generic (PLEG): container finished" podID="81ce8e2e-75ba-40bf-b49c-889d49cc1656" containerID="983fb3c8e33049f717ed9681b3f20ac1663f425a5125e8741679cdea8a187f89" exitCode=0 Jun 07 19:54:44.827185 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.827158 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" event={"ID":"81ce8e2e-75ba-40bf-b49c-889d49cc1656","Type":"ContainerDied","Data":"983fb3c8e33049f717ed9681b3f20ac1663f425a5125e8741679cdea8a187f89"} Jun 07 19:54:44.827645 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.827528 2576 scope.go:117] "RemoveContainer" containerID="983fb3c8e33049f717ed9681b3f20ac1663f425a5125e8741679cdea8a187f89" Jun 07 19:54:44.830778 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.830742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn6t" event={"ID":"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16","Type":"ContainerStarted","Data":"a8a4e13df3d658285f270b1d6780ea643406163f2b8d05ec087e8fb6961a5903"} Jun 07 19:54:44.830879 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.830831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-npn6t" event={"ID":"77d8a841-c2b4-47d3-a245-a0f0e4c9fc16","Type":"ContainerStarted","Data":"97010e899535e2f4f68910712cca0596fadb0d82435d1587988f4565fac30414"} Jun 07 19:54:44.856997 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:44.856955 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-npn6t" podStartSLOduration=252.648384338 podStartE2EDuration="4m13.856941516s" totalImagesPullingTime="1.208557178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:50:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:54:44.855743625 +0000 UTC m=+254.438258908" watchObservedRunningTime="2026-06-07 19:54:44.856941516 +0000 UTC m=+254.439456814" Jun 07 19:54:45.836734 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:45.836700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-zrvkc" event={"ID":"81ce8e2e-75ba-40bf-b49c-889d49cc1656","Type":"ContainerStarted","Data":"1a74b086b6d1227e4516e4514db63189fd86ed633b99c6ad5719054d5c6cf759"} Jun 07 19:54:53.521463 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:53.521400 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-66dc5bcc46-gfkbh" podUID="44619c4d-15ab-4ab4-be4b-f48485d84d84" containerName="console" containerID="cri-o://b2bce0bc989c35d175976fda02eac595bb4636de770ca7ea17a249e8cb12c569" gracePeriod=15 Jun 07 19:54:58.899374 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:54:58.899319 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-756bb885c4-4fwlx" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" containerID="cri-o://d22cb86d45e4c57650f7a1aac7813561ea75dd2f2927e35c77c55ce662dd3de2" gracePeriod=15 Jun 07 19:55:08.930878 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:08.930851 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66dc5bcc46-gfkbh_44619c4d-15ab-4ab4-be4b-f48485d84d84/console/0.log" Jun 07 19:55:08.931262 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:08.930883 2576 generic.go:356] "Generic (PLEG): container finished" podID="44619c4d-15ab-4ab4-be4b-f48485d84d84" containerID="b2bce0bc989c35d175976fda02eac595bb4636de770ca7ea17a249e8cb12c569" exitCode=137 Jun 07 19:55:08.934934 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:08.934908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc5bcc46-gfkbh" event={"ID":"44619c4d-15ab-4ab4-be4b-f48485d84d84","Type":"ContainerDied","Data":"b2bce0bc989c35d175976fda02eac595bb4636de770ca7ea17a249e8cb12c569"} Jun 07 19:55:09.169883 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.169862 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66dc5bcc46-gfkbh_44619c4d-15ab-4ab4-be4b-f48485d84d84/console/0.log" Jun 07 19:55:09.191049 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.191001 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:55:09.308850 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.308824 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.308879 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.308897 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.308926 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzj57\" (UniqueName: \"kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.308980 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309259 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.309035 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert\") pod \"44619c4d-15ab-4ab4-be4b-f48485d84d84\" (UID: \"44619c4d-15ab-4ab4-be4b-f48485d84d84\") " Jun 07 19:55:09.309387 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.309359 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca" (OuterVolumeSpecName: "service-ca") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:09.309499 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.309469 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config" (OuterVolumeSpecName: "console-config") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:09.309665 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.309496 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:09.311095 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.311069 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:09.311207 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.311102 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:09.311207 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.311135 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57" (OuterVolumeSpecName: "kube-api-access-jzj57") pod "44619c4d-15ab-4ab4-be4b-f48485d84d84" (UID: "44619c4d-15ab-4ab4-be4b-f48485d84d84"). InnerVolumeSpecName "kube-api-access-jzj57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:55:09.410291 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410263 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.410291 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410287 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-oauth-serving-cert\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.410429 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410301 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/44619c4d-15ab-4ab4-be4b-f48485d84d84-service-ca\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.410429 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410313 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-serving-cert\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.410429 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410324 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/44619c4d-15ab-4ab4-be4b-f48485d84d84-console-oauth-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.410429 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.410336 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzj57\" (UniqueName: \"kubernetes.io/projected/44619c4d-15ab-4ab4-be4b-f48485d84d84-kube-api-access-jzj57\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:09.937193 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.937168 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-66dc5bcc46-gfkbh_44619c4d-15ab-4ab4-be4b-f48485d84d84/console/0.log" Jun 07 19:55:09.937704 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.937235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66dc5bcc46-gfkbh" event={"ID":"44619c4d-15ab-4ab4-be4b-f48485d84d84","Type":"ContainerDied","Data":"909b9b0caedfd7527def0d7a29d5a2586b71c23af27df76415777d718a340a93"} Jun 07 19:55:09.937704 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.937284 2576 scope.go:117] "RemoveContainer" containerID="b2bce0bc989c35d175976fda02eac595bb4636de770ca7ea17a249e8cb12c569" Jun 07 19:55:09.937704 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.937286 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66dc5bcc46-gfkbh" Jun 07 19:55:09.957808 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.957784 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:55:09.961062 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:09.961039 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66dc5bcc46-gfkbh"] Jun 07 19:55:10.933988 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:10.933958 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44619c4d-15ab-4ab4-be4b-f48485d84d84" path="/var/lib/kubelet/pods/44619c4d-15ab-4ab4-be4b-f48485d84d84/volumes" Jun 07 19:55:11.397989 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:11.397948 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ln9hd" podUID="9ee03617-e2cb-497c-95e4-eb6efdb7b41e" Jun 07 19:55:11.945897 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:11.945858 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:13.959560 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:13.959533 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-756bb885c4-4fwlx_cd2348c3-25da-47ba-b15c-1fc1d4a50d33/console/0.log" Jun 07 19:55:13.959906 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:13.959569 2576 generic.go:356] "Generic (PLEG): container finished" podID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerID="d22cb86d45e4c57650f7a1aac7813561ea75dd2f2927e35c77c55ce662dd3de2" exitCode=137 Jun 07 19:55:13.959906 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:13.959657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756bb885c4-4fwlx" event={"ID":"cd2348c3-25da-47ba-b15c-1fc1d4a50d33","Type":"ContainerDied","Data":"d22cb86d45e4c57650f7a1aac7813561ea75dd2f2927e35c77c55ce662dd3de2"} Jun 07 19:55:14.054082 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.054058 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-756bb885c4-4fwlx_cd2348c3-25da-47ba-b15c-1fc1d4a50d33/console/0.log" Jun 07 19:55:14.055198 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.055183 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:55:14.148964 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.148931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.148982 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149007 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149032 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149074 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hkwx\" (UniqueName: \"kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149111 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149445 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config\") pod \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\" (UID: \"cd2348c3-25da-47ba-b15c-1fc1d4a50d33\") " Jun 07 19:55:14.149445 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149332 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:14.149549 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149512 2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-oauth-serving-cert\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.149635 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149609 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca" (OuterVolumeSpecName: "service-ca") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:14.149694 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149618 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:14.149747 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.149711 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config" (OuterVolumeSpecName: "console-config") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:14.151349 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.151319 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx" (OuterVolumeSpecName: "kube-api-access-6hkwx") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "kube-api-access-6hkwx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:55:14.151606 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.151587 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:14.151669 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.151606 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cd2348c3-25da-47ba-b15c-1fc1d4a50d33" (UID: "cd2348c3-25da-47ba-b15c-1fc1d4a50d33"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:14.250680 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250654 2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-oauth-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.250680 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250675 2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-serving-cert\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.250812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250684 2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-trusted-ca-bundle\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.250812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250694 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hkwx\" (UniqueName: \"kubernetes.io/projected/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-kube-api-access-6hkwx\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.250812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250705 2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-service-ca\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.250812 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.250713 2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cd2348c3-25da-47ba-b15c-1fc1d4a50d33-console-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:14.964372 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.964351 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-756bb885c4-4fwlx_cd2348c3-25da-47ba-b15c-1fc1d4a50d33/console/0.log" Jun 07 19:55:14.964707 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.964419 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-756bb885c4-4fwlx" event={"ID":"cd2348c3-25da-47ba-b15c-1fc1d4a50d33","Type":"ContainerDied","Data":"c66e91f0dae8008156bb0a78b20814e0795ef4bf54123374fa9a1a3bdb9fadb4"} Jun 07 19:55:14.964707 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.964433 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-756bb885c4-4fwlx" Jun 07 19:55:14.964707 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.964457 2576 scope.go:117] "RemoveContainer" containerID="d22cb86d45e4c57650f7a1aac7813561ea75dd2f2927e35c77c55ce662dd3de2" Jun 07 19:55:14.981697 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.981671 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:55:14.985270 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:14.985244 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-756bb885c4-4fwlx"] Jun 07 19:55:15.258076 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.258018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:15.260250 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.260229 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9ee03617-e2cb-497c-95e4-eb6efdb7b41e-metrics-tls\") pod \"dns-default-ln9hd\" (UID: \"9ee03617-e2cb-497c-95e4-eb6efdb7b41e\") " pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:15.549420 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.549360 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-db9r8\"" Jun 07 19:55:15.557145 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.557123 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:15.681508 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.681478 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ln9hd"] Jun 07 19:55:15.684794 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:55:15.684765 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ee03617_e2cb_497c_95e4_eb6efdb7b41e.slice/crio-eef2cd3751f11a7fb08e6d9f92c288d44b73bf709b9d07043dc7a8c06585a2e0 WatchSource:0}: Error finding container eef2cd3751f11a7fb08e6d9f92c288d44b73bf709b9d07043dc7a8c06585a2e0: Status 404 returned error can't find the container with id eef2cd3751f11a7fb08e6d9f92c288d44b73bf709b9d07043dc7a8c06585a2e0 Jun 07 19:55:15.969417 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:15.969386 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ln9hd" event={"ID":"9ee03617-e2cb-497c-95e4-eb6efdb7b41e","Type":"ContainerStarted","Data":"eef2cd3751f11a7fb08e6d9f92c288d44b73bf709b9d07043dc7a8c06585a2e0"} Jun 07 19:55:16.935849 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:16.935817 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" path="/var/lib/kubelet/pods/cd2348c3-25da-47ba-b15c-1fc1d4a50d33/volumes" Jun 07 19:55:17.979950 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:17.979917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ln9hd" event={"ID":"9ee03617-e2cb-497c-95e4-eb6efdb7b41e","Type":"ContainerStarted","Data":"bae10b066a0dd2830ec84233d96accdf0316b9e7aa49c1ff9bcd1da9aad8c0cd"} Jun 07 19:55:17.980332 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:17.979966 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ln9hd" event={"ID":"9ee03617-e2cb-497c-95e4-eb6efdb7b41e","Type":"ContainerStarted","Data":"e68003aaddc914a8b86cee9e787f124004f94430df35149ea965a110df7843bd"} Jun 07 19:55:17.980332 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:17.980010 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:17.997671 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:17.997628 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ln9hd" podStartSLOduration=251.621227623 podStartE2EDuration="4m12.997614877s" totalImagesPullingTime="1.376387254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:55:17.995510996 +0000 UTC m=+287.578026290" watchObservedRunningTime="2026-06-07 19:55:17.997614877 +0000 UTC m=+287.580130158" Jun 07 19:55:27.986884 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:27.986857 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ln9hd" Jun 07 19:55:30.240239 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.240205 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:30.258395 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.258366 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:30.874498 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.874474 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 19:55:30.878734 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.878691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:55:30.879823 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.879805 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 19:55:30.883562 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.883535 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 19:55:30.886074 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:30.886056 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 07 19:55:31.045796 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:31.045777 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:48.153562 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153526 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153818 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="prometheus" containerID="cri-o://f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" gracePeriod=600 Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153848 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy" containerID="cri-o://1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" gracePeriod=600 Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153883 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-web" containerID="cri-o://0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" gracePeriod=600 Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153894 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="thanos-sidecar" containerID="cri-o://7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" gracePeriod=600 Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153945 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="config-reloader" containerID="cri-o://ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" gracePeriod=600 Jun 07 19:55:48.154110 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.153894 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" gracePeriod=600 Jun 07 19:55:48.388023 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.388002 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:48.504162 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504116 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504322 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504167 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504322 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504186 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504322 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504256 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504322 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504296 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504325 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504380 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4lhj\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504407 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504439 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504541 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504497 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.504761 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504665 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.505268 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.504990 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505508 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505553 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505624 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505691 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505723 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505750 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505781 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.505858 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505833 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505886 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets\") pod \"48768713-eedc-4692-b6e2-78f292ce294e\" (UID: \"48768713-eedc-4692-b6e2-78f292ce294e\") " Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.505884 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.506119 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.506153 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.506170 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.506443 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.506941 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.506879 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.507457 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.507431 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.507553 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.507459 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.507553 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.507502 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.507898 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.507858 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 07 19:55:48.508201 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.507495 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out" (OuterVolumeSpecName: "config-out") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:55:48.508748 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.508724 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:55:48.508837 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.508756 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 19:55:48.508837 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.508813 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.509029 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.509001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.509098 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.509028 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.509206 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.509188 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj" (OuterVolumeSpecName: "kube-api-access-n4lhj") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "kube-api-access-n4lhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 19:55:48.510112 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.510087 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.510388 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.510372 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config" (OuterVolumeSpecName: "config") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.510518 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.510495 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.520453 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.520434 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config" (OuterVolumeSpecName: "web-config") pod "48768713-eedc-4692-b6e2-78f292ce294e" (UID: "48768713-eedc-4692-b6e2-78f292ce294e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 19:55:48.607038 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607016 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4lhj\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-kube-api-access-n4lhj\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607038 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607036 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607047 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607056 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607065 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-grpc-tls\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607074 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-db\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607081 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-metrics-client-ca\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607091 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-metrics-client-certs\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607099 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607107 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-web-config\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607115 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607123 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/48768713-eedc-4692-b6e2-78f292ce294e-tls-assets\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607131 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607154 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607163 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/48768713-eedc-4692-b6e2-78f292ce294e-secret-kube-rbac-proxy\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607171 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/48768713-eedc-4692-b6e2-78f292ce294e-config-out\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:48.607179 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:48.607179 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/48768713-eedc-4692-b6e2-78f292ce294e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 19:55:49.103310 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103277 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" exitCode=0 Jun 07 19:55:49.103310 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103307 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" exitCode=0 Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103317 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" exitCode=0 Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103325 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" exitCode=0 Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103336 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" exitCode=0 Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103348 2576 generic.go:356] "Generic (PLEG): container finished" podID="48768713-eedc-4692-b6e2-78f292ce294e" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" exitCode=0 Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103359 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103358 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103426 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103454 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} Jun 07 19:55:49.103479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} Jun 07 19:55:49.103796 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103499 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.103796 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103511 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} Jun 07 19:55:49.103796 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103537 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} Jun 07 19:55:49.103796 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.103559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"48768713-eedc-4692-b6e2-78f292ce294e","Type":"ContainerDied","Data":"44ed03c7f46628930a19a353b6576b64f26043add26ab4cf8e6c3ee0a282ec57"} Jun 07 19:55:49.113956 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.113239 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.120664 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.120647 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.125571 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.125553 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:49.128106 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.128024 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.129924 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.129903 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:49.134600 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.134584 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.141020 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.141000 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.148266 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.148251 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.153412 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153385 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:49.153680 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153665 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="thanos-sidecar" Jun 07 19:55:49.153680 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153679 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="thanos-sidecar" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153696 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-thanos" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153703 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-thanos" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153710 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="config-reloader" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153716 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="config-reloader" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153723 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44619c4d-15ab-4ab4-be4b-f48485d84d84" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153728 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44619c4d-15ab-4ab4-be4b-f48485d84d84" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153735 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-web" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153740 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-web" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153747 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153751 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153758 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="prometheus" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153763 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="prometheus" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153768 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="init-config-reloader" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153773 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="init-config-reloader" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153780 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153784 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153831 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="44619c4d-15ab-4ab4-be4b-f48485d84d84" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153839 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="config-reloader" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153845 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="prometheus" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153851 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-web" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153856 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd2348c3-25da-47ba-b15c-1fc1d4a50d33" containerName="console" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153861 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153866 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="thanos-sidecar" Jun 07 19:55:49.154075 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.153873 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="48768713-eedc-4692-b6e2-78f292ce294e" containerName="kube-rbac-proxy-thanos" Jun 07 19:55:49.156086 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.155944 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.156246 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.156226 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.156318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156257 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.156318 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156299 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.156565 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.156549 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.156607 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156570 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.156607 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156585 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.156834 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.156815 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.156898 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156843 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.156898 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.156862 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.157094 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.157078 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.157183 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157101 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.157183 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157121 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.157373 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.157355 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.157414 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157379 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.157414 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157394 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.157592 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.157573 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.157665 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157599 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.157665 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157623 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.157855 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:55:49.157840 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.157893 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157859 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.157893 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.157872 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.158056 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158037 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.158121 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158057 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.158274 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158256 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.158338 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158274 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.158452 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158438 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.158494 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158452 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.158663 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158642 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.158701 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158665 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.158876 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158857 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.158944 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.158878 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.159092 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159076 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.159230 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159093 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.159352 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159336 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.159396 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159353 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.159527 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159512 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.159562 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159527 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.159715 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159697 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.159749 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159717 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.159937 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159922 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.159976 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.159939 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.160173 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160129 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.160173 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160172 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.160382 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160366 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.160443 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160385 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.160594 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160578 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.160594 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160593 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.160809 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160785 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.160863 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160811 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.160900 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.160862 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.161312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161033 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.161312 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161053 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.161479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161322 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.161479 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161339 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.161638 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161598 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.161679 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161643 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.161926 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161908 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.161979 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.161927 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.162189 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162166 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.162279 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162191 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.162445 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162424 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.162495 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162448 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.162690 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162671 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.162749 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162692 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.162921 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162904 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.162964 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.162922 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.163135 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163120 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.163135 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163136 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.163383 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163365 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.163440 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163386 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.163615 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163588 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.163615 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163613 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.163794 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163636 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 07 19:55:49.163794 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163649 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 07 19:55:49.163912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163858 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.163912 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163875 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.164021 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163913 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 07 19:55:49.164021 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.163953 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 07 19:55:49.164119 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164056 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 07 19:55:49.164119 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164105 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.164275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164129 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.164275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164206 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 07 19:55:49.164275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164208 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-d866r\"" Jun 07 19:55:49.164275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164272 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-antai967ul78j\"" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164354 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164361 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164419 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164455 2576 scope.go:117] "RemoveContainer" containerID="37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83" Jun 07 19:55:49.164467 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164467 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 07 19:55:49.164722 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164480 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 07 19:55:49.164722 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 07 19:55:49.164818 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164728 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83"} err="failed to get container status \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": rpc error: code = NotFound desc = could not find container \"37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83\": container with ID starting with 37c4f64cc99525c49cc6c98c6ceb62b1dd63f8fcf374b81d2be86cbfc608ea83 not found: ID does not exist" Jun 07 19:55:49.164818 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164744 2576 scope.go:117] "RemoveContainer" containerID="1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024" Jun 07 19:55:49.164988 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164963 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024"} err="failed to get container status \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": rpc error: code = NotFound desc = could not find container \"1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024\": container with ID starting with 1928f3ce5ca6c5e277564b9c3919cedddeaa003a950bc3fdf9b94b28e27f2024 not found: ID does not exist" Jun 07 19:55:49.165056 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.164991 2576 scope.go:117] "RemoveContainer" containerID="0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e" Jun 07 19:55:49.165056 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165037 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 07 19:55:49.165292 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165268 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e"} err="failed to get container status \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": rpc error: code = NotFound desc = could not find container \"0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e\": container with ID starting with 0eb3d3daebb7596e490c51f5680ffe3377ced2b90d2129acabfeb6912e2df52e not found: ID does not exist" Jun 07 19:55:49.165292 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165291 2576 scope.go:117] "RemoveContainer" containerID="7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff" Jun 07 19:55:49.165547 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165521 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff"} err="failed to get container status \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": rpc error: code = NotFound desc = could not find container \"7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff\": container with ID starting with 7c139770be267bf7225c9668cc013b50fcbb4885edefb01d01fc6258e3963bff not found: ID does not exist" Jun 07 19:55:49.165547 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165548 2576 scope.go:117] "RemoveContainer" containerID="ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620" Jun 07 19:55:49.165850 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165832 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620"} err="failed to get container status \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": rpc error: code = NotFound desc = could not find container \"ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620\": container with ID starting with ab829f2a5aaa2c0bc1964df52bb334a7f4a866564e2e1af3699e4f88c9a47620 not found: ID does not exist" Jun 07 19:55:49.165919 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.165851 2576 scope.go:117] "RemoveContainer" containerID="f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd" Jun 07 19:55:49.166154 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.166120 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd"} err="failed to get container status \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": rpc error: code = NotFound desc = could not find container \"f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd\": container with ID starting with f38fbef2689543de234d777aacf3b113146a2bbb9c4264af5ee58373d879aecd not found: ID does not exist" Jun 07 19:55:49.166230 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.166161 2576 scope.go:117] "RemoveContainer" containerID="0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93" Jun 07 19:55:49.166436 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.166407 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93"} err="failed to get container status \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": rpc error: code = NotFound desc = could not find container \"0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93\": container with ID starting with 0afb4034acf9ced340c9ca18f06f7f44abbedef2bafa2689133eb110f741bc93 not found: ID does not exist" Jun 07 19:55:49.168130 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.168036 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 07 19:55:49.169317 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.169294 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 07 19:55:49.171071 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.171051 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:49.210514 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210458 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhlwd\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-kube-api-access-dhlwd\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210514 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210484 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210514 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210536 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210732 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210755 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210778 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210804 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210837 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210867 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210894 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.210963 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210946 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.211229 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210967 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.211229 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.210988 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.211229 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.211003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.211229 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.211023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312023 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312060 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312294 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312084 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312294 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312294 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312133 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.312294 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312185 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312881 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312959 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhlwd\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-kube-api-access-dhlwd\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.312997 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313067 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313102 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313443 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313487 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.313602 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313751 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313882 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313951 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.314235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.313097 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.316928 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.315255 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config-out\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.316928 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.316481 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.316928 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.316898 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.317275 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.317254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.317685 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.317658 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.317882 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.317798 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.317976 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.317954 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.318181 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.318156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.318521 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.318495 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-web-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.319880 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.319776 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.319880 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.319812 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.322442 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.320972 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.322442 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.321181 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-config\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.322442 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.321262 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.322624 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.322433 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhlwd\" (UniqueName: \"kubernetes.io/projected/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-kube-api-access-dhlwd\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.324418 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.324395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.487130 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.487065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:55:49.620301 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:49.620221 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 07 19:55:49.622470 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:55:49.622445 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebece98a_4ce8_4a5d_9a8d_f5ce0ea23cf9.slice/crio-e5c2d5ad2fdc841bd84424c4f9493fcd674007448d2ae441c7fa2f3368492515 WatchSource:0}: Error finding container e5c2d5ad2fdc841bd84424c4f9493fcd674007448d2ae441c7fa2f3368492515: Status 404 returned error can't find the container with id e5c2d5ad2fdc841bd84424c4f9493fcd674007448d2ae441c7fa2f3368492515 Jun 07 19:55:50.109518 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:50.109489 2576 generic.go:356] "Generic (PLEG): container finished" podID="ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9" containerID="d69a6ed7f97219d038207854a8339fed4af5db1962201cf7740529d895fc7ca2" exitCode=0 Jun 07 19:55:50.109642 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:50.109538 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerDied","Data":"d69a6ed7f97219d038207854a8339fed4af5db1962201cf7740529d895fc7ca2"} Jun 07 19:55:50.109642 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:50.109587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"e5c2d5ad2fdc841bd84424c4f9493fcd674007448d2ae441c7fa2f3368492515"} Jun 07 19:55:50.934064 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:50.934031 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48768713-eedc-4692-b6e2-78f292ce294e" path="/var/lib/kubelet/pods/48768713-eedc-4692-b6e2-78f292ce294e/volumes" Jun 07 19:55:51.117121 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"ae54893579542a807b4afa1a17b7f82853b55b0cf83ac12e2f617f22d2ba2e67"} Jun 07 19:55:51.117327 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117178 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"ecb8cfbd15e92adc8aec4b1ad545a8666489af25a1c771524e5b2ab4cbd0eefc"} Jun 07 19:55:51.117327 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117222 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"546babbd54b5a38fd582d013c744cf15d0e36efc033efdafd529850fe48ded33"} Jun 07 19:55:51.117327 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117260 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"327cc7edad6cbff51091901232606a1e0b0a00861320217b7387d2442a31d4d0"} Jun 07 19:55:51.117327 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"1f4ebc874b0049ab55c00cb2c8d26863d206d9a1a023ab34c9be89f4f8cfddb8"} Jun 07 19:55:51.117522 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.117342 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9","Type":"ContainerStarted","Data":"a242cbd2c5fd78b280583d761c1a80907e7d8c18b91a4873df3dade50b61c8e0"} Jun 07 19:55:51.144203 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:51.144134 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.122483138 podStartE2EDuration="2.144114504s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.631366ms" isStatefulPod=false podCreationTimestamp="2026-06-07 19:55:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:55:51.143434477 +0000 UTC m=+320.725949760" watchObservedRunningTime="2026-06-07 19:55:51.144114504 +0000 UTC m=+320.726629787" Jun 07 19:55:54.487311 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:55:54.487272 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:56:49.487762 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:56:49.487725 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:56:49.503264 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:56:49.503234 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:56:50.370172 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:56:50.370131 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 07 19:57:43.441924 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.441890 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc"] Jun 07 19:57:43.444998 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.444982 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.447390 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.447370 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 07 19:57:43.448618 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.448597 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 07 19:57:43.448713 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.448597 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-g2ksv\"" Jun 07 19:57:43.452840 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.452817 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc"] Jun 07 19:57:43.561338 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.561323 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078fe28a-138b-4041-aea2-b939703d805d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.561441 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.561383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvqt4\" (UniqueName: \"kubernetes.io/projected/078fe28a-138b-4041-aea2-b939703d805d-kube-api-access-tvqt4\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.662642 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.662618 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078fe28a-138b-4041-aea2-b939703d805d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.662729 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.662677 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvqt4\" (UniqueName: \"kubernetes.io/projected/078fe28a-138b-4041-aea2-b939703d805d-kube-api-access-tvqt4\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.662966 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.662949 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/078fe28a-138b-4041-aea2-b939703d805d-tmp\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.671797 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.671780 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvqt4\" (UniqueName: \"kubernetes.io/projected/078fe28a-138b-4041-aea2-b939703d805d-kube-api-access-tvqt4\") pod \"openshift-lws-operator-fd8ccff4c-89ccc\" (UID: \"078fe28a-138b-4041-aea2-b939703d805d\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.768616 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.768566 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" Jun 07 19:57:43.901566 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.895752 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc"] Jun 07 19:57:43.902956 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:57:43.902925 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod078fe28a_138b_4041_aea2_b939703d805d.slice/crio-5d7795260fc29aea3e0a421d9ccc945d04c78bd7725e17de1d0875eaa20a7814 WatchSource:0}: Error finding container 5d7795260fc29aea3e0a421d9ccc945d04c78bd7725e17de1d0875eaa20a7814: Status 404 returned error can't find the container with id 5d7795260fc29aea3e0a421d9ccc945d04c78bd7725e17de1d0875eaa20a7814 Jun 07 19:57:43.904408 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:43.904386 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 19:57:44.564647 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:44.564579 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" event={"ID":"078fe28a-138b-4041-aea2-b939703d805d","Type":"ContainerStarted","Data":"5d7795260fc29aea3e0a421d9ccc945d04c78bd7725e17de1d0875eaa20a7814"} Jun 07 19:57:46.577549 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:46.577515 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" event={"ID":"078fe28a-138b-4041-aea2-b939703d805d","Type":"ContainerStarted","Data":"144df239da924c8b27f70cdf032c7a79234da48cfee7f35730b3a34d2d4a292f"} Jun 07 19:57:46.592833 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:46.592789 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-89ccc" podStartSLOduration=1.036441855 podStartE2EDuration="3.59277433s" totalImagesPullingTime="2.556332475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:57:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:57:46.59163771 +0000 UTC m=+436.174152991" watchObservedRunningTime="2026-06-07 19:57:46.59277433 +0000 UTC m=+436.175289618" Jun 07 19:57:59.740632 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.740600 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl"] Jun 07 19:57:59.746591 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.746572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.750256 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.750232 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 07 19:57:59.750256 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.750245 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 07 19:57:59.750256 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.750234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rnkg9\"" Jun 07 19:57:59.750471 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.750298 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 07 19:57:59.753702 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.753682 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl"] Jun 07 19:57:59.897436 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.897412 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.897565 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.897448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42619b4a-4850-4baf-8464-b3332eba324c-manager-config\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.897565 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.897469 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wl49\" (UniqueName: \"kubernetes.io/projected/42619b4a-4850-4baf-8464-b3332eba324c-kube-api-access-2wl49\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.897565 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.897549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-metrics-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.998851 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.998787 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42619b4a-4850-4baf-8464-b3332eba324c-manager-config\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.998851 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.998820 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wl49\" (UniqueName: \"kubernetes.io/projected/42619b4a-4850-4baf-8464-b3332eba324c-kube-api-access-2wl49\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.998851 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.998846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-metrics-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.999029 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.998886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:57:59.999458 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:57:59.999429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/42619b4a-4850-4baf-8464-b3332eba324c-manager-config\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:00.001561 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.001529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-metrics-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:00.001802 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.001779 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42619b4a-4850-4baf-8464-b3332eba324c-cert\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:00.007586 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.007560 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wl49\" (UniqueName: \"kubernetes.io/projected/42619b4a-4850-4baf-8464-b3332eba324c-kube-api-access-2wl49\") pod \"lws-controller-manager-7689c54c9c-v2mdl\" (UID: \"42619b4a-4850-4baf-8464-b3332eba324c\") " pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:00.056984 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.056955 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:00.182187 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.182163 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl"] Jun 07 19:58:00.184497 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:58:00.184465 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42619b4a_4850_4baf_8464_b3332eba324c.slice/crio-f4368a8abc521a79794e26a96767631e456fcc4bd49eca37292548dc11c25d1b WatchSource:0}: Error finding container f4368a8abc521a79794e26a96767631e456fcc4bd49eca37292548dc11c25d1b: Status 404 returned error can't find the container with id f4368a8abc521a79794e26a96767631e456fcc4bd49eca37292548dc11c25d1b Jun 07 19:58:00.635083 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:00.635052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" event={"ID":"42619b4a-4850-4baf-8464-b3332eba324c","Type":"ContainerStarted","Data":"f4368a8abc521a79794e26a96767631e456fcc4bd49eca37292548dc11c25d1b"} Jun 07 19:58:02.645534 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:02.645496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" event={"ID":"42619b4a-4850-4baf-8464-b3332eba324c","Type":"ContainerStarted","Data":"ad01cf31c83c144b2efc7a970af9845d62391753a0b58095fe5188c2548c8838"} Jun 07 19:58:02.645965 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:02.645624 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:02.664398 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:02.664339 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" podStartSLOduration=1.9898550080000001 podStartE2EDuration="3.664322334s" totalImagesPullingTime="1.674467326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:57:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:58:02.662978502 +0000 UTC m=+452.245493785" watchObservedRunningTime="2026-06-07 19:58:02.664322334 +0000 UTC m=+452.246837616" Jun 07 19:58:06.147326 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.147294 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c"] Jun 07 19:58:06.153238 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.153217 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.155550 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.155527 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 07 19:58:06.155641 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.155575 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 07 19:58:06.156052 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.156039 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 07 19:58:06.156726 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.156705 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-zj4tk\"" Jun 07 19:58:06.156787 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.156766 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 07 19:58:06.172715 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.172692 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c"] Jun 07 19:58:06.251435 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.251402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.251435 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.251436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv9sj\" (UniqueName: \"kubernetes.io/projected/ea94cdb2-a944-4db6-8e07-ec440a602abd-kube-api-access-mv9sj\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.251640 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.251472 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-manifests\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.251640 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.251553 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.251640 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.251597 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-tmp\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.352987 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.352952 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.352987 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.352989 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv9sj\" (UniqueName: \"kubernetes.io/projected/ea94cdb2-a944-4db6-8e07-ec440a602abd-kube-api-access-mv9sj\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.353212 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.353121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-manifests\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.353264 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.353221 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.353301 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.353261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-tmp\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.353560 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.353540 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-manifests\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.355391 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.355367 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea94cdb2-a944-4db6-8e07-ec440a602abd-tmp\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.355605 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.355590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.355649 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.355616 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ea94cdb2-a944-4db6-8e07-ec440a602abd-webhook-cert\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.365088 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.365070 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv9sj\" (UniqueName: \"kubernetes.io/projected/ea94cdb2-a944-4db6-8e07-ec440a602abd-kube-api-access-mv9sj\") pod \"opendatahub-operator-controller-manager-8494d88f54-r7n9c\" (UID: \"ea94cdb2-a944-4db6-8e07-ec440a602abd\") " pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.463881 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.463843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:06.632034 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.632010 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c"] Jun 07 19:58:06.634733 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:58:06.634711 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea94cdb2_a944_4db6_8e07_ec440a602abd.slice/crio-0a11ec409264f7fbbb97d8d71f29c4db8459f5a67542a3b9eb82999cedb89893 WatchSource:0}: Error finding container 0a11ec409264f7fbbb97d8d71f29c4db8459f5a67542a3b9eb82999cedb89893: Status 404 returned error can't find the container with id 0a11ec409264f7fbbb97d8d71f29c4db8459f5a67542a3b9eb82999cedb89893 Jun 07 19:58:06.664061 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:06.664022 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" event={"ID":"ea94cdb2-a944-4db6-8e07-ec440a602abd","Type":"ContainerStarted","Data":"0a11ec409264f7fbbb97d8d71f29c4db8459f5a67542a3b9eb82999cedb89893"} Jun 07 19:58:09.682193 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:09.682133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" event={"ID":"ea94cdb2-a944-4db6-8e07-ec440a602abd","Type":"ContainerStarted","Data":"a6ae4d72c32e60200bc876ee222653d43a87a0b765a3162ece19c6d2afe96dfe"} Jun 07 19:58:10.688391 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:10.688351 2576 generic.go:356] "Generic (PLEG): container finished" podID="ea94cdb2-a944-4db6-8e07-ec440a602abd" containerID="a6ae4d72c32e60200bc876ee222653d43a87a0b765a3162ece19c6d2afe96dfe" exitCode=0 Jun 07 19:58:10.688761 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:10.688418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" event={"ID":"ea94cdb2-a944-4db6-8e07-ec440a602abd","Type":"ContainerDied","Data":"a6ae4d72c32e60200bc876ee222653d43a87a0b765a3162ece19c6d2afe96dfe"} Jun 07 19:58:11.695041 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:11.695004 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" event={"ID":"ea94cdb2-a944-4db6-8e07-ec440a602abd","Type":"ContainerStarted","Data":"a6627f48693ad3a77704641c16600fe95dd9190969bb116157d240ea84372975"} Jun 07 19:58:11.695521 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:11.695113 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:11.717310 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:11.717262 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" podStartSLOduration=1.5498121409999999 podStartE2EDuration="5.717249396s" totalImagesPullingTime="3.197449437s" totalInitContainerRuntime="969.987818ms" isStatefulPod=false podCreationTimestamp="2026-06-07 19:58:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:58:11.715810045 +0000 UTC m=+461.298325362" watchObservedRunningTime="2026-06-07 19:58:11.717249396 +0000 UTC m=+461.299764677" Jun 07 19:58:13.652319 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:13.652289 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7689c54c9c-v2mdl" Jun 07 19:58:22.701220 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:22.701187 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8494d88f54-r7n9c" Jun 07 19:58:30.523084 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.523044 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5"] Jun 07 19:58:30.527515 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.527496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.530050 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.530024 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 07 19:58:30.530050 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.530039 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 07 19:58:30.530246 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.530076 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 19:58:30.531013 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.530995 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 07 19:58:30.531117 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.530998 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9rsr8\"" Jun 07 19:58:30.535543 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.535527 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5"] Jun 07 19:58:30.550743 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.550718 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.550888 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.550747 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wbrt\" (UniqueName: \"kubernetes.io/projected/df0f5253-5249-45da-a312-4bd3af884e6e-kube-api-access-4wbrt\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.550888 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.550826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0f5253-5249-45da-a312-4bd3af884e6e-tmp\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.652079 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.652047 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.652079 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.652078 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wbrt\" (UniqueName: \"kubernetes.io/projected/df0f5253-5249-45da-a312-4bd3af884e6e-kube-api-access-4wbrt\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.652408 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.652128 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0f5253-5249-45da-a312-4bd3af884e6e-tmp\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.652408 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:58:30.652234 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 07 19:58:30.652408 ip-10-0-139-107 kubenswrapper[2576]: E0607 19:58:30.652319 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs podName:df0f5253-5249-45da-a312-4bd3af884e6e nodeName:}" failed. No retries permitted until 2026-06-07 19:58:31.152297341 +0000 UTC m=+480.734812601 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs") pod "kube-auth-proxy-6b8646f5c9-p5th5" (UID: "df0f5253-5249-45da-a312-4bd3af884e6e") : secret "kube-auth-proxy-tls" not found Jun 07 19:58:30.654341 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.654322 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df0f5253-5249-45da-a312-4bd3af884e6e-tmp\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:30.665627 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:30.665604 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wbrt\" (UniqueName: \"kubernetes.io/projected/df0f5253-5249-45da-a312-4bd3af884e6e-kube-api-access-4wbrt\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:31.157341 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.157303 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:31.160485 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.160456 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/df0f5253-5249-45da-a312-4bd3af884e6e-tls-certs\") pod \"kube-auth-proxy-6b8646f5c9-p5th5\" (UID: \"df0f5253-5249-45da-a312-4bd3af884e6e\") " pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:31.441403 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.441373 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9rsr8\"" Jun 07 19:58:31.449235 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.449213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" Jun 07 19:58:31.584664 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.584625 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5"] Jun 07 19:58:31.587602 ip-10-0-139-107 kubenswrapper[2576]: W0607 19:58:31.587577 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf0f5253_5249_45da_a312_4bd3af884e6e.slice/crio-62a0a393afa866155102416ef8f0c28b8a2aff8f5704b72bfa1edea8fe2987d3 WatchSource:0}: Error finding container 62a0a393afa866155102416ef8f0c28b8a2aff8f5704b72bfa1edea8fe2987d3: Status 404 returned error can't find the container with id 62a0a393afa866155102416ef8f0c28b8a2aff8f5704b72bfa1edea8fe2987d3 Jun 07 19:58:31.788575 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:31.788479 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" event={"ID":"df0f5253-5249-45da-a312-4bd3af884e6e","Type":"ContainerStarted","Data":"62a0a393afa866155102416ef8f0c28b8a2aff8f5704b72bfa1edea8fe2987d3"} Jun 07 19:58:34.216853 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:34.216832 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 07 19:58:34.807223 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:34.807183 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" event={"ID":"df0f5253-5249-45da-a312-4bd3af884e6e","Type":"ContainerStarted","Data":"a7cbf29440c3539017943eaeff6b2381f4d3e913c97bc311090b3fe8d0bf00ad"} Jun 07 19:58:34.823403 ip-10-0-139-107 kubenswrapper[2576]: I0607 19:58:34.823357 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6b8646f5c9-p5th5" podStartSLOduration=2.198577268 podStartE2EDuration="4.823342975s" totalImagesPullingTime="2.624765707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 19:58:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 19:58:34.821510279 +0000 UTC m=+484.404025552" watchObservedRunningTime="2026-06-07 19:58:34.823342975 +0000 UTC m=+484.405858256" Jun 07 20:00:04.985527 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.985496 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br"] Jun 07 20:00:04.988774 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.988758 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:04.991257 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.991235 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 07 20:00:04.991387 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.991285 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 07 20:00:04.991387 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.991285 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 07 20:00:04.992238 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:04.992219 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-scvss\"" Jun 07 20:00:05.000703 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.000686 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br"] Jun 07 20:00:05.029398 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.029376 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ss6w\" (UniqueName: \"kubernetes.io/projected/44eaf223-6106-4db2-9b74-535056ad71fb-kube-api-access-6ss6w\") pod \"dns-operator-controller-manager-864dd78c4c-cq6br\" (UID: \"44eaf223-6106-4db2-9b74-535056ad71fb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:05.130351 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.130326 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ss6w\" (UniqueName: \"kubernetes.io/projected/44eaf223-6106-4db2-9b74-535056ad71fb-kube-api-access-6ss6w\") pod \"dns-operator-controller-manager-864dd78c4c-cq6br\" (UID: \"44eaf223-6106-4db2-9b74-535056ad71fb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:05.151091 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.151066 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ss6w\" (UniqueName: \"kubernetes.io/projected/44eaf223-6106-4db2-9b74-535056ad71fb-kube-api-access-6ss6w\") pod \"dns-operator-controller-manager-864dd78c4c-cq6br\" (UID: \"44eaf223-6106-4db2-9b74-535056ad71fb\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:05.298869 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.298791 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:05.433657 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:05.433631 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br"] Jun 07 20:00:05.436179 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:00:05.436127 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44eaf223_6106_4db2_9b74_535056ad71fb.slice/crio-a2f2618c4950c8cc3f3bea09f155c18365a34461b276fd2b28b1b96b1f8b4e77 WatchSource:0}: Error finding container a2f2618c4950c8cc3f3bea09f155c18365a34461b276fd2b28b1b96b1f8b4e77: Status 404 returned error can't find the container with id a2f2618c4950c8cc3f3bea09f155c18365a34461b276fd2b28b1b96b1f8b4e77 Jun 07 20:00:06.207867 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:06.207830 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" event={"ID":"44eaf223-6106-4db2-9b74-535056ad71fb","Type":"ContainerStarted","Data":"a2f2618c4950c8cc3f3bea09f155c18365a34461b276fd2b28b1b96b1f8b4e77"} Jun 07 20:00:08.219621 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:08.219589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" event={"ID":"44eaf223-6106-4db2-9b74-535056ad71fb","Type":"ContainerStarted","Data":"789337963fe6bf91bb8ede11d0799d02bf3e49c5f26e66e80eb252eb5da4541b"} Jun 07 20:00:08.219990 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:08.219649 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:08.236094 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:08.236052 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" podStartSLOduration=2.142203609 podStartE2EDuration="4.236037817s" totalImagesPullingTime="2.093834208s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:00:08.235045343 +0000 UTC m=+577.817560625" watchObservedRunningTime="2026-06-07 20:00:08.236037817 +0000 UTC m=+577.818553170" Jun 07 20:00:09.891182 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.891133 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n"] Jun 07 20:00:09.894696 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.894675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:09.900905 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.900877 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-zb828\"" Jun 07 20:00:09.904288 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.904259 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n"] Jun 07 20:00:09.969867 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.969843 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:09.969999 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:09.969886 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz7n9\" (UniqueName: \"kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.070954 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.070927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.071079 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.070972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz7n9\" (UniqueName: \"kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.071372 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.071348 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.078827 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.078805 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz7n9\" (UniqueName: \"kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.210994 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.210969 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:10.341616 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:10.341576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n"] Jun 07 20:00:10.344453 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:00:10.344423 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaba6edc_b574_4edc_9d31_189a1a5df8dd.slice/crio-c55372ecaa3d04b29d7b9c2844b30fc26c5d8e1929054a08d1ce3a4557c474f6 WatchSource:0}: Error finding container c55372ecaa3d04b29d7b9c2844b30fc26c5d8e1929054a08d1ce3a4557c474f6: Status 404 returned error can't find the container with id c55372ecaa3d04b29d7b9c2844b30fc26c5d8e1929054a08d1ce3a4557c474f6 Jun 07 20:00:11.234998 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:11.234960 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" event={"ID":"eaba6edc-b574-4edc-9d31-189a1a5df8dd","Type":"ContainerStarted","Data":"c55372ecaa3d04b29d7b9c2844b30fc26c5d8e1929054a08d1ce3a4557c474f6"} Jun 07 20:00:15.256688 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:15.256651 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" event={"ID":"eaba6edc-b574-4edc-9d31-189a1a5df8dd","Type":"ContainerStarted","Data":"845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658"} Jun 07 20:00:15.257099 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:15.256764 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:15.275509 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:15.275459 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" podStartSLOduration=1.8538116100000002 podStartE2EDuration="6.275445494s" totalImagesPullingTime="4.421633884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:00:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:00:15.272631919 +0000 UTC m=+584.855147200" watchObservedRunningTime="2026-06-07 20:00:15.275445494 +0000 UTC m=+584.857960773" Jun 07 20:00:19.226866 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:19.226836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cq6br" Jun 07 20:00:26.264183 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:26.264153 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:27.919990 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.919962 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n"] Jun 07 20:00:27.920369 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.920154 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" containerName="manager" containerID="cri-o://845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658" gracePeriod=2 Jun 07 20:00:27.930606 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.930238 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n"] Jun 07 20:00:27.933724 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:27.933680 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"eaba6edc-b574-4edc-9d31-189a1a5df8dd\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-dw55n\": pods \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:27.952270 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.952240 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:27.952764 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.952744 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" containerName="manager" Jun 07 20:00:27.952823 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.952771 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" containerName="manager" Jun 07 20:00:27.952903 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.952891 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" containerName="manager" Jun 07 20:00:27.958347 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.958329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:27.973702 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:27.973677 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:27.992399 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:27.992371 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" is forbidden: User \"system:node:ip-10-0-139-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-107.ec2.internal' and this object" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.014860 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.014836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.014971 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.014885 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.115478 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.115445 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.115606 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.115490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.115882 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.115859 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.124182 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.124161 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jch4j\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.157745 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.157727 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.159836 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:28.159809 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" is forbidden: User \"system:node:ip-10-0-139-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-107.ec2.internal' and this object" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.215807 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.215784 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dz7n9\" (UniqueName: \"kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9\") pod \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " Jun 07 20:00:28.215922 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.215875 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume\") pod \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\" (UID: \"eaba6edc-b574-4edc-9d31-189a1a5df8dd\") " Jun 07 20:00:28.216336 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.216315 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eaba6edc-b574-4edc-9d31-189a1a5df8dd" (UID: "eaba6edc-b574-4edc-9d31-189a1a5df8dd"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 20:00:28.217949 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.217925 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9" (OuterVolumeSpecName: "kube-api-access-dz7n9") pod "eaba6edc-b574-4edc-9d31-189a1a5df8dd" (UID: "eaba6edc-b574-4edc-9d31-189a1a5df8dd"). InnerVolumeSpecName "kube-api-access-dz7n9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 20:00:28.297131 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.297111 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:28.316797 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.316777 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dz7n9\" (UniqueName: \"kubernetes.io/projected/eaba6edc-b574-4edc-9d31-189a1a5df8dd-kube-api-access-dz7n9\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:00:28.316896 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.316802 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eaba6edc-b574-4edc-9d31-189a1a5df8dd-extensions-socket-volume\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:00:28.317913 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.317892 2576 generic.go:356] "Generic (PLEG): container finished" podID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" containerID="845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658" exitCode=0 Jun 07 20:00:28.318001 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.317934 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.318046 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.317998 2576 scope.go:117] "RemoveContainer" containerID="845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658" Jun 07 20:00:28.320084 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:28.320056 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" is forbidden: User \"system:node:ip-10-0-139-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-107.ec2.internal' and this object" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.327714 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.327695 2576 scope.go:117] "RemoveContainer" containerID="845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658" Jun 07 20:00:28.327970 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:28.327953 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658\": container with ID starting with 845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658 not found: ID does not exist" containerID="845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658" Jun 07 20:00:28.328039 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.327979 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658"} err="failed to get container status \"845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658\": rpc error: code = NotFound desc = could not find container \"845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658\": container with ID starting with 845ec16066d6e8b39898681afa35149522279582dd91db04dcdfa2ab618d5658 not found: ID does not exist" Jun 07 20:00:28.328610 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:28.328584 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-dw55n\" is forbidden: User \"system:node:ip-10-0-139-107.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-107.ec2.internal' and this object" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-dw55n" Jun 07 20:00:28.431078 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.431055 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:28.435126 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:00:28.435102 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda807dc01_fb99_4ee3_ab4b_80414cbca056.slice/crio-f48863e7ed26f6dbaa9b9e0de423dde2f47f258e895e67136229122c7fa0002b WatchSource:0}: Error finding container f48863e7ed26f6dbaa9b9e0de423dde2f47f258e895e67136229122c7fa0002b: Status 404 returned error can't find the container with id f48863e7ed26f6dbaa9b9e0de423dde2f47f258e895e67136229122c7fa0002b Jun 07 20:00:28.935677 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:28.935652 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eaba6edc-b574-4edc-9d31-189a1a5df8dd" path="/var/lib/kubelet/pods/eaba6edc-b574-4edc-9d31-189a1a5df8dd/volumes" Jun 07 20:00:29.324423 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:29.324325 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" event={"ID":"a807dc01-fb99-4ee3-ab4b-80414cbca056","Type":"ContainerStarted","Data":"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953"} Jun 07 20:00:29.324423 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:29.324385 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" event={"ID":"a807dc01-fb99-4ee3-ab4b-80414cbca056","Type":"ContainerStarted","Data":"f48863e7ed26f6dbaa9b9e0de423dde2f47f258e895e67136229122c7fa0002b"} Jun 07 20:00:29.324423 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:29.324411 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:29.343488 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:29.343443 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" podStartSLOduration=2.343428976 podStartE2EDuration="2.343428976s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:00:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:00:29.340764042 +0000 UTC m=+598.923279323" watchObservedRunningTime="2026-06-07 20:00:29.343428976 +0000 UTC m=+598.925944256" Jun 07 20:00:30.909597 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:30.909554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:00:30.910135 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:30.909563 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:00:30.919508 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:30.919483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:00:30.919637 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:30.919483 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:00:40.332600 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:40.332570 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:43.134294 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.134260 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:43.134728 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.134451 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" podUID="a807dc01-fb99-4ee3-ab4b-80414cbca056" containerName="manager" containerID="cri-o://080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953" gracePeriod=10 Jun 07 20:00:43.322032 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.322001 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj"] Jun 07 20:00:43.326380 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.326360 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.336204 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.336176 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj"] Jun 07 20:00:43.388239 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.388191 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:43.389629 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.389603 2576 generic.go:356] "Generic (PLEG): container finished" podID="a807dc01-fb99-4ee3-ab4b-80414cbca056" containerID="080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953" exitCode=0 Jun 07 20:00:43.389718 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.389637 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" Jun 07 20:00:43.389718 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.389667 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" event={"ID":"a807dc01-fb99-4ee3-ab4b-80414cbca056","Type":"ContainerDied","Data":"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953"} Jun 07 20:00:43.389718 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.389710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j" event={"ID":"a807dc01-fb99-4ee3-ab4b-80414cbca056","Type":"ContainerDied","Data":"f48863e7ed26f6dbaa9b9e0de423dde2f47f258e895e67136229122c7fa0002b"} Jun 07 20:00:43.389816 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.389731 2576 scope.go:117] "RemoveContainer" containerID="080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953" Jun 07 20:00:43.397982 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.397964 2576 scope.go:117] "RemoveContainer" containerID="080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953" Jun 07 20:00:43.398240 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:00:43.398224 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953\": container with ID starting with 080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953 not found: ID does not exist" containerID="080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953" Jun 07 20:00:43.398293 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.398248 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953"} err="failed to get container status \"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953\": rpc error: code = NotFound desc = could not find container \"080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953\": container with ID starting with 080e566cb4167f9533a7b6498ef3177acb5990799394973fdecbc334c4d9b953 not found: ID does not exist" Jun 07 20:00:43.442154 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.442123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.442236 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.442169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njhf2\" (UniqueName: \"kubernetes.io/projected/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-kube-api-access-njhf2\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.542932 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.542907 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume\") pod \"a807dc01-fb99-4ee3-ab4b-80414cbca056\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " Jun 07 20:00:43.543052 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.542959 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c\") pod \"a807dc01-fb99-4ee3-ab4b-80414cbca056\" (UID: \"a807dc01-fb99-4ee3-ab4b-80414cbca056\") " Jun 07 20:00:43.543155 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.543113 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.543278 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.543181 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njhf2\" (UniqueName: \"kubernetes.io/projected/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-kube-api-access-njhf2\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.543352 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.543324 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a807dc01-fb99-4ee3-ab4b-80414cbca056" (UID: "a807dc01-fb99-4ee3-ab4b-80414cbca056"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 07 20:00:43.543551 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.543532 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.545023 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.545001 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c" (OuterVolumeSpecName: "kube-api-access-nqz5c") pod "a807dc01-fb99-4ee3-ab4b-80414cbca056" (UID: "a807dc01-fb99-4ee3-ab4b-80414cbca056"). InnerVolumeSpecName "kube-api-access-nqz5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 20:00:43.551399 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.551376 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njhf2\" (UniqueName: \"kubernetes.io/projected/74f13fc7-77d7-48a3-b58e-2ccd1fc39593-kube-api-access-njhf2\") pod \"kuadrant-operator-controller-manager-86878c769f-fmdnj\" (UID: \"74f13fc7-77d7-48a3-b58e-2ccd1fc39593\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.637732 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.637710 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:43.644452 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.644437 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nqz5c\" (UniqueName: \"kubernetes.io/projected/a807dc01-fb99-4ee3-ab4b-80414cbca056-kube-api-access-nqz5c\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:00:43.644503 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.644456 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a807dc01-fb99-4ee3-ab4b-80414cbca056-extensions-socket-volume\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:00:43.714427 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.714402 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:43.720896 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.720872 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jch4j"] Jun 07 20:00:43.770395 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:43.770120 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj"] Jun 07 20:00:43.773374 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:00:43.773339 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74f13fc7_77d7_48a3_b58e_2ccd1fc39593.slice/crio-e1f752d7e33b865640a546af73b4a68873d6b8676505ca2ace9b23f60d32d9f7 WatchSource:0}: Error finding container e1f752d7e33b865640a546af73b4a68873d6b8676505ca2ace9b23f60d32d9f7: Status 404 returned error can't find the container with id e1f752d7e33b865640a546af73b4a68873d6b8676505ca2ace9b23f60d32d9f7 Jun 07 20:00:44.396804 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:44.396768 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" event={"ID":"74f13fc7-77d7-48a3-b58e-2ccd1fc39593","Type":"ContainerStarted","Data":"771dc9d0d3cd126c2a5bb7f6645a3975068d7897c011810dbe0d8fa6c0a2abca"} Jun 07 20:00:44.397214 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:44.396825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" event={"ID":"74f13fc7-77d7-48a3-b58e-2ccd1fc39593","Type":"ContainerStarted","Data":"e1f752d7e33b865640a546af73b4a68873d6b8676505ca2ace9b23f60d32d9f7"} Jun 07 20:00:44.397214 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:44.396882 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:00:44.415776 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:44.415737 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" podStartSLOduration=1.415719051 podStartE2EDuration="1.415719051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:00:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:00:44.413710645 +0000 UTC m=+613.996225955" watchObservedRunningTime="2026-06-07 20:00:44.415719051 +0000 UTC m=+613.998234333" Jun 07 20:00:44.935176 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:44.935127 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a807dc01-fb99-4ee3-ab4b-80414cbca056" path="/var/lib/kubelet/pods/a807dc01-fb99-4ee3-ab4b-80414cbca056/volumes" Jun 07 20:00:55.403768 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:00:55.403740 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-fmdnj" Jun 07 20:01:15.469038 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.469004 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:15.470405 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.470376 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a807dc01-fb99-4ee3-ab4b-80414cbca056" containerName="manager" Jun 07 20:01:15.470550 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.470538 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a807dc01-fb99-4ee3-ab4b-80414cbca056" containerName="manager" Jun 07 20:01:15.470829 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.470815 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a807dc01-fb99-4ee3-ab4b-80414cbca056" containerName="manager" Jun 07 20:01:15.474822 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.474798 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:15.477774 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.477752 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-k7tp8\"" Jun 07 20:01:15.478759 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.478734 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:15.586053 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.586020 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hdnx\" (UniqueName: \"kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx\") pod \"authorino-58cd955675-qsppc\" (UID: \"30ca14ab-2877-4138-8831-1e670b1a703f\") " pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:15.687367 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.687338 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hdnx\" (UniqueName: \"kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx\") pod \"authorino-58cd955675-qsppc\" (UID: \"30ca14ab-2877-4138-8831-1e670b1a703f\") " pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:15.695284 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.695263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hdnx\" (UniqueName: \"kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx\") pod \"authorino-58cd955675-qsppc\" (UID: \"30ca14ab-2877-4138-8831-1e670b1a703f\") " pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:15.786274 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.786218 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:15.910266 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:15.910242 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:15.913354 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:01:15.913331 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30ca14ab_2877_4138_8831_1e670b1a703f.slice/crio-4806493f5633cbb3bea75a655d2182b5a3363136db74485c432ddd8e31625385 WatchSource:0}: Error finding container 4806493f5633cbb3bea75a655d2182b5a3363136db74485c432ddd8e31625385: Status 404 returned error can't find the container with id 4806493f5633cbb3bea75a655d2182b5a3363136db74485c432ddd8e31625385 Jun 07 20:01:16.549200 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:16.549166 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsppc" event={"ID":"30ca14ab-2877-4138-8831-1e670b1a703f","Type":"ContainerStarted","Data":"4806493f5633cbb3bea75a655d2182b5a3363136db74485c432ddd8e31625385"} Jun 07 20:01:19.567123 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:19.567088 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsppc" event={"ID":"30ca14ab-2877-4138-8831-1e670b1a703f","Type":"ContainerStarted","Data":"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79"} Jun 07 20:01:19.581747 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:19.581704 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qsppc" podStartSLOduration=1.428834474 podStartE2EDuration="4.581689827s" totalImagesPullingTime="3.152855353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:01:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:01:19.580249941 +0000 UTC m=+649.162765219" watchObservedRunningTime="2026-06-07 20:01:19.581689827 +0000 UTC m=+649.164205107" Jun 07 20:01:20.406834 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:20.406776 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:21.577233 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:21.577195 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qsppc" podUID="30ca14ab-2877-4138-8831-1e670b1a703f" containerName="authorino" containerID="cri-o://f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79" gracePeriod=30 Jun 07 20:01:21.821898 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:21.821877 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:21.944692 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:21.944666 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hdnx\" (UniqueName: \"kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx\") pod \"30ca14ab-2877-4138-8831-1e670b1a703f\" (UID: \"30ca14ab-2877-4138-8831-1e670b1a703f\") " Jun 07 20:01:21.946597 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:21.946578 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx" (OuterVolumeSpecName: "kube-api-access-8hdnx") pod "30ca14ab-2877-4138-8831-1e670b1a703f" (UID: "30ca14ab-2877-4138-8831-1e670b1a703f"). InnerVolumeSpecName "kube-api-access-8hdnx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 20:01:22.045772 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.045747 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hdnx\" (UniqueName: \"kubernetes.io/projected/30ca14ab-2877-4138-8831-1e670b1a703f-kube-api-access-8hdnx\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:01:22.583764 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.583732 2576 generic.go:356] "Generic (PLEG): container finished" podID="30ca14ab-2877-4138-8831-1e670b1a703f" containerID="f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79" exitCode=0 Jun 07 20:01:22.583764 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.583763 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsppc" Jun 07 20:01:22.584305 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.583813 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsppc" event={"ID":"30ca14ab-2877-4138-8831-1e670b1a703f","Type":"ContainerDied","Data":"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79"} Jun 07 20:01:22.584305 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.583854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsppc" event={"ID":"30ca14ab-2877-4138-8831-1e670b1a703f","Type":"ContainerDied","Data":"4806493f5633cbb3bea75a655d2182b5a3363136db74485c432ddd8e31625385"} Jun 07 20:01:22.584305 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.583871 2576 scope.go:117] "RemoveContainer" containerID="f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79" Jun 07 20:01:22.593092 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.593074 2576 scope.go:117] "RemoveContainer" containerID="f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79" Jun 07 20:01:22.593353 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:01:22.593334 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79\": container with ID starting with f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79 not found: ID does not exist" containerID="f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79" Jun 07 20:01:22.593413 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.593361 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79"} err="failed to get container status \"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79\": rpc error: code = NotFound desc = could not find container \"f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79\": container with ID starting with f98c01c55aaab0fc3b7c9460d0d616c8ad4947c99dfb976fe634d9a15fb20a79 not found: ID does not exist" Jun 07 20:01:22.604711 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.604691 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:22.606203 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.606186 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsppc"] Jun 07 20:01:22.934086 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:22.934060 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30ca14ab-2877-4138-8831-1e670b1a703f" path="/var/lib/kubelet/pods/30ca14ab-2877-4138-8831-1e670b1a703f/volumes" Jun 07 20:01:35.517098 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.517059 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp"] Jun 07 20:01:35.517562 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.517419 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30ca14ab-2877-4138-8831-1e670b1a703f" containerName="authorino" Jun 07 20:01:35.517562 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.517430 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="30ca14ab-2877-4138-8831-1e670b1a703f" containerName="authorino" Jun 07 20:01:35.517562 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.517493 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="30ca14ab-2877-4138-8831-1e670b1a703f" containerName="authorino" Jun 07 20:01:35.524600 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.524579 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.527179 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.527135 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"postgres-creds\"" Jun 07 20:01:35.527283 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.527240 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"redhat-ai-gateway-infra\"/\"default-dockercfg-kf5bz\"" Jun 07 20:01:35.528162 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.528124 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jun 07 20:01:35.528162 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.528135 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"redhat-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jun 07 20:01:35.529625 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.529605 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp"] Jun 07 20:01:35.646407 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.646385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f77235b3-ebc6-424c-85eb-e966b493232d-data\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.646545 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.646447 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mw55q\" (UniqueName: \"kubernetes.io/projected/f77235b3-ebc6-424c-85eb-e966b493232d-kube-api-access-mw55q\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.747689 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.747663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f77235b3-ebc6-424c-85eb-e966b493232d-data\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.747806 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.747709 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mw55q\" (UniqueName: \"kubernetes.io/projected/f77235b3-ebc6-424c-85eb-e966b493232d-kube-api-access-mw55q\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.748040 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.748021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/f77235b3-ebc6-424c-85eb-e966b493232d-data\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.755793 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.755775 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mw55q\" (UniqueName: \"kubernetes.io/projected/f77235b3-ebc6-424c-85eb-e966b493232d-kube-api-access-mw55q\") pod \"postgres-69fb4594cf-jmnhp\" (UID: \"f77235b3-ebc6-424c-85eb-e966b493232d\") " pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.836307 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.836250 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:35.960926 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:35.960838 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp"] Jun 07 20:01:35.963667 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:01:35.963642 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77235b3_ebc6_424c_85eb_e966b493232d.slice/crio-a13ead641684de0c89483335dd27649b0bf8c6a9ef906b43d1297af9f593b868 WatchSource:0}: Error finding container a13ead641684de0c89483335dd27649b0bf8c6a9ef906b43d1297af9f593b868: Status 404 returned error can't find the container with id a13ead641684de0c89483335dd27649b0bf8c6a9ef906b43d1297af9f593b868 Jun 07 20:01:36.651448 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:36.651413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" event={"ID":"f77235b3-ebc6-424c-85eb-e966b493232d","Type":"ContainerStarted","Data":"a13ead641684de0c89483335dd27649b0bf8c6a9ef906b43d1297af9f593b868"} Jun 07 20:01:40.675618 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:40.675580 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" event={"ID":"f77235b3-ebc6-424c-85eb-e966b493232d","Type":"ContainerStarted","Data":"f3c66650f7721f7d07a85e3491d5538da2b3d0bc2dc2ff515dcaeb754efc0e45"} Jun 07 20:01:40.675960 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:40.675718 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:01:40.691962 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:40.691919 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" podStartSLOduration=1.437041877 podStartE2EDuration="5.691908182s" totalImagesPullingTime="4.254866305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:01:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:01:40.68983785 +0000 UTC m=+670.272353132" watchObservedRunningTime="2026-06-07 20:01:40.691908182 +0000 UTC m=+670.274423461" Jun 07 20:01:46.711867 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:01:46.711840 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="redhat-ai-gateway-infra/postgres-69fb4594cf-jmnhp" Jun 07 20:02:15.785839 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.785764 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 20:02:15.796829 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.796801 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:15.797571 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.797548 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 20:02:15.799406 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.799367 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 07 20:02:15.799518 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.799411 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 07 20:02:15.799581 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.799521 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-cjh8t\"" Jun 07 20:02:15.799666 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.799652 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 07 20:02:15.871972 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.871941 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkknt\" (UniqueName: \"kubernetes.io/projected/b9e8ba50-1c42-42ed-96e8-c234483da50b-kube-api-access-nkknt\") pod \"maas-keycloak-0\" (UID: \"b9e8ba50-1c42-42ed-96e8-c234483da50b\") " pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:15.972645 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.972605 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkknt\" (UniqueName: \"kubernetes.io/projected/b9e8ba50-1c42-42ed-96e8-c234483da50b-kube-api-access-nkknt\") pod \"maas-keycloak-0\" (UID: \"b9e8ba50-1c42-42ed-96e8-c234483da50b\") " pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:15.980383 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:15.980353 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkknt\" (UniqueName: \"kubernetes.io/projected/b9e8ba50-1c42-42ed-96e8-c234483da50b-kube-api-access-nkknt\") pod \"maas-keycloak-0\" (UID: \"b9e8ba50-1c42-42ed-96e8-c234483da50b\") " pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:16.107699 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:16.107625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:16.242305 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:16.242248 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 07 20:02:16.244581 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:02:16.244560 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9e8ba50_1c42_42ed_96e8_c234483da50b.slice/crio-0dd7cb17d36ef063bac657f508a7be776e427bedc89430baffc90116d978398d WatchSource:0}: Error finding container 0dd7cb17d36ef063bac657f508a7be776e427bedc89430baffc90116d978398d: Status 404 returned error can't find the container with id 0dd7cb17d36ef063bac657f508a7be776e427bedc89430baffc90116d978398d Jun 07 20:02:16.852977 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:16.852940 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9e8ba50-1c42-42ed-96e8-c234483da50b","Type":"ContainerStarted","Data":"0dd7cb17d36ef063bac657f508a7be776e427bedc89430baffc90116d978398d"} Jun 07 20:02:20.874759 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:20.874731 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"b9e8ba50-1c42-42ed-96e8-c234483da50b","Type":"ContainerStarted","Data":"e3144bdac241c5a70595d6d1324d658d20e618c1c6d2ae8ab3c605daebfe580a"} Jun 07 20:02:20.891834 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:20.891784 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.330591696 podStartE2EDuration="5.891769382s" totalImagesPullingTime="4.561177686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:02:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:02:20.889384499 +0000 UTC m=+710.471899780" watchObservedRunningTime="2026-06-07 20:02:20.891769382 +0000 UTC m=+710.474284663" Jun 07 20:02:21.108299 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:21.108210 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:21.109896 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:21.109867 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:22.108197 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:22.108133 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:23.108668 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:23.108618 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:24.108566 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:24.108519 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:25.108488 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:25.108445 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:26.108788 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:26.108736 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:26.109793 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:26.109751 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:27.108574 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:27.108518 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:28.108727 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:28.108666 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:29.108934 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:29.108886 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:30.108501 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:30.108457 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:31.108465 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:31.108429 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:32.108902 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:32.108856 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:33.108506 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:33.108460 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 07 20:02:34.200428 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:34.200395 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:34.214356 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:34.214310 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="b9e8ba50-1c42-42ed-96e8-c234483da50b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 07 20:02:44.206208 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:44.206175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 07 20:02:50.407111 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.407080 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:02:50.410854 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.410833 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.413652 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.413627 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 07 20:02:50.413775 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.413649 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 07 20:02:50.414003 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.413984 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-sj4ks\"" Jun 07 20:02:50.423605 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.423584 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:02:50.494774 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.494741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2vxx\" (UniqueName: \"kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.494774 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.494779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.592182 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.592155 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6b64884c9f-wk89h"] Jun 07 20:02:50.595468 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.595444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2vxx\" (UniqueName: \"kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.595585 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.595473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.595625 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:02:50.595604 2576 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jun 07 20:02:50.595670 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:02:50.595660 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert podName:6d232090-94d1-41e9-ac77-ce1d7c94505c nodeName:}" failed. No retries permitted until 2026-06-07 20:02:51.095646391 +0000 UTC m=+740.678161651 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert") pod "maas-controller-556fc45fbd-ggs9z" (UID: "6d232090-94d1-41e9-ac77-ce1d7c94505c") : secret "maas-controller-webhook-cert" not found Jun 07 20:02:50.595868 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.595853 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.602530 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.602505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b64884c9f-wk89h"] Jun 07 20:02:50.607312 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.607289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2vxx\" (UniqueName: \"kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:50.696657 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.696621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31a51b1-3beb-4d58-8500-cbf712c3ce04-webhook-cert\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.696847 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.696748 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp9q9\" (UniqueName: \"kubernetes.io/projected/e31a51b1-3beb-4d58-8500-cbf712c3ce04-kube-api-access-wp9q9\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.797728 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.797697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31a51b1-3beb-4d58-8500-cbf712c3ce04-webhook-cert\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.797913 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.797766 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp9q9\" (UniqueName: \"kubernetes.io/projected/e31a51b1-3beb-4d58-8500-cbf712c3ce04-kube-api-access-wp9q9\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.800167 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.800132 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e31a51b1-3beb-4d58-8500-cbf712c3ce04-webhook-cert\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.809927 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.806278 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp9q9\" (UniqueName: \"kubernetes.io/projected/e31a51b1-3beb-4d58-8500-cbf712c3ce04-kube-api-access-wp9q9\") pod \"maas-controller-6b64884c9f-wk89h\" (UID: \"e31a51b1-3beb-4d58-8500-cbf712c3ce04\") " pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:50.907832 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:50.907792 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:51.036701 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.036672 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6b64884c9f-wk89h"] Jun 07 20:02:51.039563 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:02:51.039528 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31a51b1_3beb_4d58_8500_cbf712c3ce04.slice/crio-d5b36dca6b045cb2d02bcff7dd8880596456651302e64685e2edf672d0183ef3 WatchSource:0}: Error finding container d5b36dca6b045cb2d02bcff7dd8880596456651302e64685e2edf672d0183ef3: Status 404 returned error can't find the container with id d5b36dca6b045cb2d02bcff7dd8880596456651302e64685e2edf672d0183ef3 Jun 07 20:02:51.040846 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.040829 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 07 20:02:51.100475 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.100444 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:51.103182 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.103156 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") pod \"maas-controller-556fc45fbd-ggs9z\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:51.322752 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.322674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:51.454326 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:51.454300 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:02:51.455651 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:02:51.455627 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d232090_94d1_41e9_ac77_ce1d7c94505c.slice/crio-6a41f67a5afe64958b43e5249a03ad200d65be18dfdc3c011c15a82451577aba WatchSource:0}: Error finding container 6a41f67a5afe64958b43e5249a03ad200d65be18dfdc3c011c15a82451577aba: Status 404 returned error can't find the container with id 6a41f67a5afe64958b43e5249a03ad200d65be18dfdc3c011c15a82451577aba Jun 07 20:02:52.054644 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:52.054534 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b64884c9f-wk89h" event={"ID":"e31a51b1-3beb-4d58-8500-cbf712c3ce04","Type":"ContainerStarted","Data":"d5b36dca6b045cb2d02bcff7dd8880596456651302e64685e2edf672d0183ef3"} Jun 07 20:02:52.056452 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:52.056421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" event={"ID":"6d232090-94d1-41e9-ac77-ce1d7c94505c","Type":"ContainerStarted","Data":"6a41f67a5afe64958b43e5249a03ad200d65be18dfdc3c011c15a82451577aba"} Jun 07 20:02:55.074068 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.074030 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" event={"ID":"6d232090-94d1-41e9-ac77-ce1d7c94505c","Type":"ContainerStarted","Data":"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961"} Jun 07 20:02:55.074580 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.074105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:02:55.075856 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.075828 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6b64884c9f-wk89h" event={"ID":"e31a51b1-3beb-4d58-8500-cbf712c3ce04","Type":"ContainerStarted","Data":"2081a0e235cb0f70be60785164172dcf5b0c1f62c2a6c01e086949d73547a859"} Jun 07 20:02:55.075968 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.075915 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:02:55.095483 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.095441 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" podStartSLOduration=2.1153364630000002 podStartE2EDuration="5.095425314s" totalImagesPullingTime="2.980088851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:02:55.094058858 +0000 UTC m=+744.676574140" watchObservedRunningTime="2026-06-07 20:02:55.095425314 +0000 UTC m=+744.677940595" Jun 07 20:02:55.117313 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:02:55.117264 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6b64884c9f-wk89h" podStartSLOduration=1.730750504 podStartE2EDuration="5.117246122s" totalImagesPullingTime="3.386495618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-07 20:02:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:02:55.115594266 +0000 UTC m=+744.698109558" watchObservedRunningTime="2026-06-07 20:02:55.117246122 +0000 UTC m=+744.699761457" Jun 07 20:03:06.084959 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.084928 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6b64884c9f-wk89h" Jun 07 20:03:06.085417 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.085195 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:03:06.140637 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.140605 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:03:06.140843 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.140818 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" podUID="6d232090-94d1-41e9-ac77-ce1d7c94505c" containerName="manager" containerID="cri-o://8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961" gracePeriod=30 Jun 07 20:03:06.384828 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.384804 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:03:06.436280 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.436251 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") pod \"6d232090-94d1-41e9-ac77-ce1d7c94505c\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " Jun 07 20:03:06.436280 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.436280 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2vxx\" (UniqueName: \"kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx\") pod \"6d232090-94d1-41e9-ac77-ce1d7c94505c\" (UID: \"6d232090-94d1-41e9-ac77-ce1d7c94505c\") " Jun 07 20:03:06.438355 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.438327 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d232090-94d1-41e9-ac77-ce1d7c94505c" (UID: "6d232090-94d1-41e9-ac77-ce1d7c94505c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 07 20:03:06.438471 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.438427 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx" (OuterVolumeSpecName: "kube-api-access-d2vxx") pod "6d232090-94d1-41e9-ac77-ce1d7c94505c" (UID: "6d232090-94d1-41e9-ac77-ce1d7c94505c"). InnerVolumeSpecName "kube-api-access-d2vxx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 07 20:03:06.537193 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.537167 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d232090-94d1-41e9-ac77-ce1d7c94505c-webhook-cert\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:03:06.537193 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:06.537189 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2vxx\" (UniqueName: \"kubernetes.io/projected/6d232090-94d1-41e9-ac77-ce1d7c94505c-kube-api-access-d2vxx\") on node \"ip-10-0-139-107.ec2.internal\" DevicePath \"\"" Jun 07 20:03:07.133821 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.133785 2576 generic.go:356] "Generic (PLEG): container finished" podID="6d232090-94d1-41e9-ac77-ce1d7c94505c" containerID="8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961" exitCode=0 Jun 07 20:03:07.133821 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.133822 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" event={"ID":"6d232090-94d1-41e9-ac77-ce1d7c94505c","Type":"ContainerDied","Data":"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961"} Jun 07 20:03:07.134369 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.133834 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" Jun 07 20:03:07.134369 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.133858 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-556fc45fbd-ggs9z" event={"ID":"6d232090-94d1-41e9-ac77-ce1d7c94505c","Type":"ContainerDied","Data":"6a41f67a5afe64958b43e5249a03ad200d65be18dfdc3c011c15a82451577aba"} Jun 07 20:03:07.134369 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.133879 2576 scope.go:117] "RemoveContainer" containerID="8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961" Jun 07 20:03:07.142725 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.142549 2576 scope.go:117] "RemoveContainer" containerID="8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961" Jun 07 20:03:07.142807 ip-10-0-139-107 kubenswrapper[2576]: E0607 20:03:07.142783 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961\": container with ID starting with 8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961 not found: ID does not exist" containerID="8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961" Jun 07 20:03:07.142862 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.142819 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961"} err="failed to get container status \"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961\": rpc error: code = NotFound desc = could not find container \"8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961\": container with ID starting with 8a12172d1498cc9301a6cdf844f2ee44f26ca8a72d8708dee8baf29d9c77d961 not found: ID does not exist" Jun 07 20:03:07.149925 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.149901 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:03:07.152311 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:07.152291 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-556fc45fbd-ggs9z"] Jun 07 20:03:08.935565 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:03:08.935528 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d232090-94d1-41e9-ac77-ce1d7c94505c" path="/var/lib/kubelet/pods/6d232090-94d1-41e9-ac77-ce1d7c94505c/volumes" Jun 07 20:05:30.948189 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:05:30.948102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:05:30.949545 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:05:30.949522 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:05:30.951893 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:05:30.951870 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:05:30.953508 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:05:30.953490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:10:30.977685 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:10:30.977658 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:10:30.979760 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:10:30.979732 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:10:30.980876 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:10:30.980857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:10:30.983202 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:10:30.983185 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6qcvq_94b792e8-7bff-40d9-8654-86bf4f6fd2d9/ovn-acl-logging/0.log" Jun 07 20:13:17.554826 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:17.554788 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b64884c9f-wk89h_e31a51b1-3beb-4d58-8500-cbf712c3ce04/manager/0.log" Jun 07 20:13:18.019530 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:18.019500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d88f54-r7n9c_ea94cdb2-a944-4db6-8e07-ec440a602abd/manager/0.log" Jun 07 20:13:18.026774 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:18.026753 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d88f54-r7n9c_ea94cdb2-a944-4db6-8e07-ec440a602abd/copy-manifests/0.log" Jun 07 20:13:19.623442 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:19.623417 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cq6br_44eaf223-6106-4db2-9b74-535056ad71fb/manager/0.log" Jun 07 20:13:19.977651 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:19.977615 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmdnj_74f13fc7-77d7-48a3-b58e-2ccd1fc39593/manager/0.log" Jun 07 20:13:20.884045 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:20.883985 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b8646f5c9-p5th5_df0f5253-5249-45da-a312-4bd3af884e6e/kube-auth-proxy/0.log" Jun 07 20:13:29.055577 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:29.055551 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nt4x2_c21e2990-219c-4b52-94ed-60a7676b57a3/global-pull-secret-syncer/0.log" Jun 07 20:13:29.183996 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:29.183972 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-b29wt_712460e9-634e-4c3e-95cb-b5ba282f4c0e/konnectivity-agent/0.log" Jun 07 20:13:29.274931 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:29.274905 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-107.ec2.internal_315bddd24f7efc22924c6fa01e51e8cc/haproxy/0.log" Jun 07 20:13:34.465188 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:34.465136 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cq6br_44eaf223-6106-4db2-9b74-535056ad71fb/manager/0.log" Jun 07 20:13:34.593916 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:34.593886 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-fmdnj_74f13fc7-77d7-48a3-b58e-2ccd1fc39593/manager/0.log" Jun 07 20:13:36.369177 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.369118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-7kcwx_1935d00b-dfe4-44eb-9bf0-1783184245a0/cluster-monitoring-operator/0.log" Jun 07 20:13:36.393746 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.393657 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6fbx_bd8b0501-59ed-44e8-a39c-7f5384e3c289/kube-state-metrics/0.log" Jun 07 20:13:36.415702 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.415663 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6fbx_bd8b0501-59ed-44e8-a39c-7f5384e3c289/kube-rbac-proxy-main/0.log" Jun 07 20:13:36.437057 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.436989 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-w6fbx_bd8b0501-59ed-44e8-a39c-7f5384e3c289/kube-rbac-proxy-self/0.log" Jun 07 20:13:36.494802 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.494785 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-7djwv_d2414fba-cdb1-4721-8ea5-4c1d831ecbc1/monitoring-plugin/0.log" Jun 07 20:13:36.547540 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.547521 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pppwh_7dfc1f88-558a-4ed2-9141-b9437f9fbe53/node-exporter/0.log" Jun 07 20:13:36.575297 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.575277 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pppwh_7dfc1f88-558a-4ed2-9141-b9437f9fbe53/kube-rbac-proxy/0.log" Jun 07 20:13:36.596642 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.596624 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pppwh_7dfc1f88-558a-4ed2-9141-b9437f9fbe53/init-textfile/0.log" Jun 07 20:13:36.805051 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.805033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pqbh9_3e50319d-9444-41fb-8d9b-7edeec56ea47/kube-rbac-proxy-main/0.log" Jun 07 20:13:36.826328 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.826310 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pqbh9_3e50319d-9444-41fb-8d9b-7edeec56ea47/kube-rbac-proxy-self/0.log" Jun 07 20:13:36.849938 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.849917 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-pqbh9_3e50319d-9444-41fb-8d9b-7edeec56ea47/openshift-state-metrics/0.log" Jun 07 20:13:36.895161 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.895125 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/prometheus/0.log" Jun 07 20:13:36.920320 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.920301 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/config-reloader/0.log" Jun 07 20:13:36.941858 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.941842 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/thanos-sidecar/0.log" Jun 07 20:13:36.965935 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.965915 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/kube-rbac-proxy-web/0.log" Jun 07 20:13:36.987434 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:36.987415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/kube-rbac-proxy/0.log" Jun 07 20:13:37.017042 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.017019 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/kube-rbac-proxy-thanos/0.log" Jun 07 20:13:37.039549 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.039529 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ebece98a-4ce8-4a5d-9a8d-f5ce0ea23cf9/init-config-reloader/0.log" Jun 07 20:13:37.113304 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.113253 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-whlxd_7eb7e911-7b31-4930-b50f-d045fe547e34/prometheus-operator-admission-webhook/0.log" Jun 07 20:13:37.146915 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.146898 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b6bb44f8-z2r8j_8b2c149b-de7a-4541-92c3-fe6d2727cfe4/telemeter-client/0.log" Jun 07 20:13:37.165969 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.165952 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b6bb44f8-z2r8j_8b2c149b-de7a-4541-92c3-fe6d2727cfe4/reload/0.log" Jun 07 20:13:37.184737 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:37.184712 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-75b6bb44f8-z2r8j_8b2c149b-de7a-4541-92c3-fe6d2727cfe4/kube-rbac-proxy/0.log" Jun 07 20:13:38.719559 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:38.719525 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-cz6ld_a8164f07-a9fc-4741-8d46-c054d082b5ac/networking-console-plugin/0.log" Jun 07 20:13:39.329113 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:39.329088 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/1.log" Jun 07 20:13:39.335587 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:39.335566 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-v27dh_8872f51c-16e4-4390-abd3-0b392206c9a5/console-operator/2.log" Jun 07 20:13:39.901887 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:39.901857 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-2t8tl_8ba106ad-953d-4d91-81ca-48a7cff9da28/download-server/0.log" Jun 07 20:13:40.237756 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.237708 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx"] Jun 07 20:13:40.238115 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.238098 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d232090-94d1-41e9-ac77-ce1d7c94505c" containerName="manager" Jun 07 20:13:40.238196 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.238118 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d232090-94d1-41e9-ac77-ce1d7c94505c" containerName="manager" Jun 07 20:13:40.238234 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.238207 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d232090-94d1-41e9-ac77-ce1d7c94505c" containerName="manager" Jun 07 20:13:40.243157 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.243127 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.245262 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.245229 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kw65h\"/\"kube-root-ca.crt\"" Jun 07 20:13:40.245359 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.245337 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kw65h\"/\"openshift-service-ca.crt\"" Jun 07 20:13:40.246464 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.246446 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kw65h\"/\"default-dockercfg-rsh4f\"" Jun 07 20:13:40.252083 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.252062 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx"] Jun 07 20:13:40.295862 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.295836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-sys\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.295958 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.295864 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-lib-modules\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.295958 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.295925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-proc\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.295958 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.295954 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-podres\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.296096 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.295972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z5lt\" (UniqueName: \"kubernetes.io/projected/996443d1-2209-43d6-998e-ed1ad40b094b-kube-api-access-4z5lt\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397041 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-podres\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397191 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397053 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z5lt\" (UniqueName: \"kubernetes.io/projected/996443d1-2209-43d6-998e-ed1ad40b094b-kube-api-access-4z5lt\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397191 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-sys\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397191 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-lib-modules\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397578 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-podres\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397578 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-sys\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397578 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-lib-modules\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397578 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-proc\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.397578 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.397366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/996443d1-2209-43d6-998e-ed1ad40b094b-proc\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.404794 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.404773 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z5lt\" (UniqueName: \"kubernetes.io/projected/996443d1-2209-43d6-998e-ed1ad40b094b-kube-api-access-4z5lt\") pod \"perf-node-gather-daemonset-xc2tx\" (UID: \"996443d1-2209-43d6-998e-ed1ad40b094b\") " pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.553828 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.553753 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:40.638129 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.638098 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-gmckx_bf6f2475-5407-4bd2-be57-b343d325fe5c/volume-data-source-validator/0.log" Jun 07 20:13:40.680603 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:40.680577 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx"] Jun 07 20:13:40.682747 ip-10-0-139-107 kubenswrapper[2576]: W0607 20:13:40.682723 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod996443d1_2209_43d6_998e_ed1ad40b094b.slice/crio-40378fffd14cb5eac003a0c64e6e5312b66378105e77c8a73def6a407ff41d14 WatchSource:0}: Error finding container 40378fffd14cb5eac003a0c64e6e5312b66378105e77c8a73def6a407ff41d14: Status 404 returned error can't find the container with id 40378fffd14cb5eac003a0c64e6e5312b66378105e77c8a73def6a407ff41d14 Jun 07 20:13:41.131764 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.131732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" event={"ID":"996443d1-2209-43d6-998e-ed1ad40b094b","Type":"ContainerStarted","Data":"7b9f1b1a2d6eb5473b073642ae8335bc588222eaa2a45716b3635b36b15bec46"} Jun 07 20:13:41.132154 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.131780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" event={"ID":"996443d1-2209-43d6-998e-ed1ad40b094b","Type":"ContainerStarted","Data":"40378fffd14cb5eac003a0c64e6e5312b66378105e77c8a73def6a407ff41d14"} Jun 07 20:13:41.132154 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.131875 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:41.146468 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.146421 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" podStartSLOduration=1.146405245 podStartE2EDuration="1.146405245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-07 20:13:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-07 20:13:41.145725721 +0000 UTC m=+1390.728241006" watchObservedRunningTime="2026-06-07 20:13:41.146405245 +0000 UTC m=+1390.728920529" Jun 07 20:13:41.830420 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.830385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ln9hd_9ee03617-e2cb-497c-95e4-eb6efdb7b41e/dns/0.log" Jun 07 20:13:41.850109 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:41.850088 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ln9hd_9ee03617-e2cb-497c-95e4-eb6efdb7b41e/kube-rbac-proxy/0.log" Jun 07 20:13:42.005034 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:42.005010 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pxnq7_02bb1a1e-07bd-4524-bcdb-bb70bf76310d/dns-node-resolver/0.log" Jun 07 20:13:42.600639 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:42.600613 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vb2md_94da0729-0586-4e21-9689-035efa5efa5e/node-ca/0.log" Jun 07 20:13:43.595111 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:43.595082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b8646f5c9-p5th5_df0f5253-5249-45da-a312-4bd3af884e6e/kube-auth-proxy/0.log" Jun 07 20:13:44.226638 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:44.226606 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-54tzw_0721b842-43b6-42cd-8e69-70da07618f62/serve-healthcheck-canary/0.log" Jun 07 20:13:44.864207 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:44.864174 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms28r_64eb1ef5-7eb4-4637-a505-97e51f62c9d9/kube-rbac-proxy/0.log" Jun 07 20:13:44.884017 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:44.883992 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms28r_64eb1ef5-7eb4-4637-a505-97e51f62c9d9/exporter/0.log" Jun 07 20:13:44.902600 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:44.902582 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-ms28r_64eb1ef5-7eb4-4637-a505-97e51f62c9d9/extractor/0.log" Jun 07 20:13:47.146304 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:47.146276 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kw65h/perf-node-gather-daemonset-xc2tx" Jun 07 20:13:47.318416 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:47.318383 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6b64884c9f-wk89h_e31a51b1-3beb-4d58-8500-cbf712c3ce04/manager/0.log" Jun 07 20:13:47.476199 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:47.476164 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d88f54-r7n9c_ea94cdb2-a944-4db6-8e07-ec440a602abd/manager/0.log" Jun 07 20:13:47.491942 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:47.491919 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8494d88f54-r7n9c_ea94cdb2-a944-4db6-8e07-ec440a602abd/copy-manifests/0.log" Jun 07 20:13:49.063245 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:49.063177 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7689c54c9c-v2mdl_42619b4a-4850-4baf-8464-b3332eba324c/manager/0.log" Jun 07 20:13:49.090054 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:49.090028 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-89ccc_078fe28a-138b-4041-aea2-b939703d805d/openshift-lws-operator/0.log" Jun 07 20:13:54.216122 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:54.216084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b8646f5c9-p5th5_df0f5253-5249-45da-a312-4bd3af884e6e/kube-auth-proxy/0.log" Jun 07 20:13:54.330949 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:54.330921 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-qqzj7_4bbd929c-7657-400b-8797-95eaa2c46018/migrator/0.log" Jun 07 20:13:54.356994 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:54.356968 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-qqzj7_4bbd929c-7657-400b-8797-95eaa2c46018/graceful-termination/0.log" Jun 07 20:13:55.282916 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:55.282885 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b8646f5c9-p5th5_df0f5253-5249-45da-a312-4bd3af884e6e/kube-auth-proxy/0.log" Jun 07 20:13:56.383240 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.383172 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/kube-multus-additional-cni-plugins/0.log" Jun 07 20:13:56.402162 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.402117 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/egress-router-binary-copy/0.log" Jun 07 20:13:56.420396 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.420373 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/cni-plugins/0.log" Jun 07 20:13:56.442987 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.442965 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/bond-cni-plugin/0.log" Jun 07 20:13:56.461526 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.461502 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/routeoverride-cni/0.log" Jun 07 20:13:56.479951 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.479926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/whereabouts-cni-bincopy/0.log" Jun 07 20:13:56.498195 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.498174 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cd7jv_2093ed5a-364b-4deb-8ef5-98cc24058563/whereabouts-cni/0.log" Jun 07 20:13:56.552780 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.552757 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wcwv2_ad217ed7-987b-47ab-9dcb-ac81ea77a425/kube-multus/0.log" Jun 07 20:13:56.613514 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.613490 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npn6t_77d8a841-c2b4-47d3-a245-a0f0e4c9fc16/network-metrics-daemon/0.log" Jun 07 20:13:56.631583 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.631561 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-npn6t_77d8a841-c2b4-47d3-a245-a0f0e4c9fc16/kube-rbac-proxy/0.log" Jun 07 20:13:56.873837 ip-10-0-139-107 kubenswrapper[2576]: I0607 20:13:56.873808 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6b8646f5c9-p5th5_df0f5253-5249-45da-a312-4bd3af884e6e/kube-auth-proxy/0.log"