Jun 09 11:43:23.381106 ip-10-0-138-33 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:43:23.782495 ip-10-0-138-33 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:43:23.782495 ip-10-0-138-33 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:43:23.782495 ip-10-0-138-33 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:43:23.782495 ip-10-0-138-33 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:43:23.782495 ip-10-0-138-33 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:43:23.783409 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.783318 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:43:23.787789 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787768 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787790 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787795 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787799 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787802 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787805 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787808 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787811 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787823 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787827 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787830 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787834 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787837 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787840 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787843 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.787838 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787846 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787849 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787852 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787854 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787857 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787860 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787863 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787865 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787870 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787873 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787876 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787878 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787881 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787885 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787887 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787890 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787892 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787895 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787897 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787900 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.788201 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787902 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787905 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787908 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787910 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787913 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787916 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787919 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787921 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787924 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787926 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787929 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787932 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787935 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787937 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787940 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787943 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787945 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787948 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787950 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787953 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.788693 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787956 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787958 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787961 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787963 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787966 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787968 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787971 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787973 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787977 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787980 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787983 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787986 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787988 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787991 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787993 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787996 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.787999 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788003 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788006 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788009 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.789247 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788011 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788014 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788016 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788019 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788021 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788024 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788028 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788032 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788035 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788038 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788041 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788044 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788046 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788049 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788052 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788055 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788058 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788060 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788063 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.789761 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788065 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788068 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788070 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788073 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788076 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788916 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788923 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788926 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788929 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788932 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788939 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788942 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788945 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788948 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788950 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788953 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788955 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788958 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788961 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788964 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.790218 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788967 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788969 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788972 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788975 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788977 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788980 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788982 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788985 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788988 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788991 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788993 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788996 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.788999 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789001 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789004 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789006 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789009 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789011 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789014 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.790701 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789016 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789019 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789022 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789026 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789030 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789033 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789036 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789038 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789041 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789044 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789046 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789049 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789052 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789055 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789058 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789063 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789066 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789069 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789073 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.791183 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789076 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789079 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789082 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789085 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789088 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789091 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789094 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789097 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789100 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789103 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789106 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789109 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789111 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789114 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789116 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789119 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789122 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789125 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789128 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789130 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.791651 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789133 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789137 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789139 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789142 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789144 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789147 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789149 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789152 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789154 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789158 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789162 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789165 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789167 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789171 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789173 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789176 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789179 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789181 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789184 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.792172 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789187 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789189 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789192 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789194 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789197 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789199 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789202 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789657 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789662 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789669 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789672 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789676 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789679 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789682 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789685 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789688 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789691 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789694 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789709 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789714 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.792624 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789717 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789720 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789723 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789726 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789729 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789732 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789735 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789737 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789740 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789757 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789760 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789763 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789766 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789769 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789772 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789775 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789777 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789780 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789783 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.793145 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789785 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789788 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789791 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789794 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789796 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789800 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789803 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789805 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789808 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789812 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789814 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789817 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789820 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789822 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789825 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789827 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789829 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789832 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789834 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789837 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.793609 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789839 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789842 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789846 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789850 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789853 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789857 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789860 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789863 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789866 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789869 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789871 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789874 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789877 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789879 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789883 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789886 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789888 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789891 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789894 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.794136 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789896 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789899 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789902 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789904 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789907 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789909 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789912 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789914 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789917 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789920 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789922 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789925 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789927 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789930 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789932 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789935 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789937 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789940 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789942 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789945 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.794594 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789948 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789951 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789954 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789956 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789959 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789962 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789964 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.789967 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790041 2562 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790050 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790057 2562 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790061 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790066 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790070 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790077 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790082 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790085 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790088 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790092 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790095 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790099 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790102 2562 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:43:23.795087 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790105 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790108 2562 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790111 2562 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790114 2562 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790118 2562 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790121 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790124 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790128 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790131 2562 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790135 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790139 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790142 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790145 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790148 2562 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790151 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790154 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790157 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790162 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790166 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790170 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790173 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790176 2562 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790179 2562 flags.go:64] FLAG: --enable-server="true" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790183 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790189 2562 flags.go:64] FLAG: --event-burst="100" Jun 09 11:43:23.795609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790192 2562 flags.go:64] FLAG: --event-qps="50" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790195 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790198 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790201 2562 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790205 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790208 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790211 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790214 2562 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790217 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790219 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790222 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790226 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790229 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790232 2562 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790234 2562 flags.go:64] FLAG: --feature-gates="" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790239 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790242 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790245 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790248 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790251 2562 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790254 2562 flags.go:64] FLAG: --help="false" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790258 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-138-33.ec2.internal" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790261 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790264 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:43:23.796231 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790270 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790273 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790277 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790280 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790282 2562 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790286 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790289 2562 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790293 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790296 2562 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790299 2562 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790302 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790305 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790308 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790311 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790313 2562 flags.go:64] FLAG: --lock-file="" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790316 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790319 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790322 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790327 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790330 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790333 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790336 2562 flags.go:64] FLAG: --logging-format="text" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790339 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790342 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:43:23.797348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790345 2562 flags.go:64] FLAG: --manifest-url="" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790349 2562 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790353 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790357 2562 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790362 2562 flags.go:64] FLAG: --max-pods="110" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790365 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790368 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790371 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790377 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790380 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790383 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790386 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790394 2562 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790397 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790400 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790403 2562 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790407 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790413 2562 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790416 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790419 2562 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790422 2562 flags.go:64] FLAG: --port="10250" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790425 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790428 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07c311e009a707921" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790431 2562 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:43:23.798535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790434 2562 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790437 2562 flags.go:64] FLAG: --register-node="true" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790439 2562 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790443 2562 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790446 2562 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790449 2562 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790452 2562 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790456 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790459 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790462 2562 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790465 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790468 2562 flags.go:64] FLAG: --runonce="false" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790471 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790474 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790477 2562 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790480 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790484 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790489 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790492 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790495 2562 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790498 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790500 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790504 2562 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790506 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790509 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:43:23.799646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790513 2562 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790516 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790522 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790524 2562 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790527 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790531 2562 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790534 2562 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790537 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790540 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790542 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790545 2562 flags.go:64] FLAG: --v="2" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790550 2562 flags.go:64] FLAG: --version="false" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790554 2562 flags.go:64] FLAG: --vmodule="" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790557 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.790560 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790736 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790740 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790761 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790766 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790771 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790775 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790779 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790782 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.800619 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790787 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790791 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790794 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790797 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790801 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790803 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790806 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790808 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790812 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790816 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790820 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790823 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790827 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790829 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790832 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790834 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790837 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790840 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790842 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790845 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.801494 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790848 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790850 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790853 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790855 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790858 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790860 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790863 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790866 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790869 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790873 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790876 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790879 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790886 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790890 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790893 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790896 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790898 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790901 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790903 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.802375 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790906 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790909 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790911 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790914 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790917 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790920 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790922 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790925 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790927 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790930 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790932 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790935 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790938 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790940 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790943 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790945 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790948 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790951 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790955 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.802914 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790958 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790961 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790964 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790966 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790969 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790972 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790976 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790980 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790983 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790986 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790988 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790991 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790993 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790996 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.790999 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791001 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791004 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791007 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791010 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791013 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.803552 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791015 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791018 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791020 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791023 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791025 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791028 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791030 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791033 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791035 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791038 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791040 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791043 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.791045 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.791051 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.798790 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:43:23.804117 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.798813 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.798843 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.798854 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798944 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798952 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798959 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798967 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798975 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798980 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798985 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798989 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798993 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.798998 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799002 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799006 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799011 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799016 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799020 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.804569 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799024 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799029 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799033 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799038 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799042 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799046 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799051 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799055 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799060 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799064 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799068 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799072 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799076 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799080 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799085 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799090 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799094 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799099 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799104 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799109 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.805048 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799114 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799119 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799127 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799131 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799135 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799140 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799144 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799148 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799152 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799157 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799163 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799167 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799171 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799176 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799180 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799184 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799188 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799192 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799197 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799202 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.805621 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799206 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799210 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799215 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799219 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799223 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799227 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799232 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799236 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799241 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799245 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799250 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799254 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799258 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799262 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799267 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799271 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799274 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799279 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799283 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799287 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.806195 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799291 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799295 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799299 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799304 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799309 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799313 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799317 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799323 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799329 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799334 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799340 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799344 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799349 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799353 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799357 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799361 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799366 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799370 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799374 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.806788 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799378 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799383 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799387 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799391 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799396 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.799404 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799595 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799604 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799612 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799617 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799621 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799625 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799630 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799634 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799638 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:43:23.807580 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799642 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799646 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799651 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799655 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799659 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799663 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799666 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799670 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799676 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799680 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799684 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799689 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799693 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799697 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799702 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799706 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799710 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799715 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799719 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799723 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:43:23.808452 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799728 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799732 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799737 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799741 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799765 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799769 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799773 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799777 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799781 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799784 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799788 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799791 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799795 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799800 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799804 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799809 2562 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799813 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799817 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799821 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799825 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:43:23.809224 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799830 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799837 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799843 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799847 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799852 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799856 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799860 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799865 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799869 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799874 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799878 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799882 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799886 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799890 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799895 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799899 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799903 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799907 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799911 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799915 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:43:23.809908 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799919 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799923 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799927 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799931 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799936 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799940 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799944 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799948 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799952 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799956 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799960 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799964 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799972 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799976 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799980 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799984 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799988 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799992 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.799996 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:43:23.810502 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800000 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800005 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800009 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800013 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800017 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800021 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800025 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800029 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800033 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800037 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:23.800044 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.800052 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.800239 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.803149 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:43:23.811088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.804446 2562 server.go:1019] "Starting client certificate rotation" Jun 09 11:43:23.811517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.804562 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:43:23.811517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.805320 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:43:23.811517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.807395 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:43:23.814593 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.814551 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:43:23.825942 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.825915 2562 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:43:23.828463 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.828444 2562 log.go:25] "Validated CRI v1 image API" Jun 09 11:43:23.829289 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.829269 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:43:23.831643 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.831621 2562 fs.go:135] Filesystem UUIDs: map[67e5a736-8658-41cb-8eae-22b5ea099eab:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 b23cacf4-f068-4729-96e3-c95949f88ec5:/dev/nvme0n1p3] Jun 09 11:43:23.831643 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.831643 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:43:23.837348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.837219 2562 manager.go:216] Machine: {Timestamp:2026-06-09 11:43:23.835845981 +0000 UTC m=+0.336701161 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110781 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2121c1a1208283ecadaedc6aed986f SystemUUID:ec2121c1-a120-8283-ecad-aedc6aed986f BootID:44825c0c-61b0-4690-8fa3-040d1b885e04 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b6:4c:8d:2d:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b6:4c:8d:2d:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d2:3a:45:74:a2:5d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:43:23.837348 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.837336 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:43:23.837494 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.837431 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:43:23.838571 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.838551 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:43:23.840493 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.840461 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:43:23.840652 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.840497 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-33.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:43:23.841273 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.841262 2562 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:43:23.841312 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.841276 2562 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:43:23.841312 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.841285 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:43:23.842002 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.841990 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:43:23.842846 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.842835 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:43:23.845860 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.845845 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:43:23.845996 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.845985 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:43:23.846031 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846023 2562 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:43:23.846071 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846037 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:43:23.846071 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846053 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:43:23.846071 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846068 2562 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:43:23.846181 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846078 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:43:23.846506 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846493 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:43:23.846563 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.846513 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:43:23.854394 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.854373 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:43:23.856230 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.856215 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:43:23.856288 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.856247 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:43:23.857194 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857182 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:43:23.857228 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857213 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:43:23.857228 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857221 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:43:23.857279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857229 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:43:23.857279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857242 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:43:23.857279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857251 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:43:23.857279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857264 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:43:23.857279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857273 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:43:23.857440 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857283 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:43:23.857440 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857290 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:43:23.857440 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857307 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:43:23.857440 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857314 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:43:23.857947 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857936 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:43:23.857988 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.857951 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:43:23.858268 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.858245 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-33.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:43:23.858331 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.858275 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:43:23.861380 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.861344 2562 server.go:1268] "Started kubelet" Jun 09 11:43:23.861477 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.861443 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:43:23.861544 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.861505 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:43:23.864984 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.864955 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfqpj" Jun 09 11:43:23.865197 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.861447 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:43:23.865348 ip-10-0-138-33 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:43:23.867461 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.866084 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:43:23.867682 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.867536 2562 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:43:23.870088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.869802 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-33.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:43:23.870594 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.870574 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:43:23.872916 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.872900 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kfqpj" Jun 09 11:43:23.873631 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.873617 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:43:23.873740 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.873717 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:43:23.873854 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.873819 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:23.874298 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874280 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:43:23.874382 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874359 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:43:23.874382 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874380 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:43:23.874602 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874586 2562 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:43:23.874602 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874599 2562 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:43:23.874857 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874839 2562 factory.go:55] Registering systemd factory Jun 09 11:43:23.874857 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.874859 2562 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:43:23.875104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875090 2562 factory.go:153] Registering CRI-O factory Jun 09 11:43:23.875104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875102 2562 factory.go:223] Registration of the crio container factory successfully Jun 09 11:43:23.875225 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875147 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:43:23.875225 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875170 2562 factory.go:103] Registering Raw factory Jun 09 11:43:23.875225 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875183 2562 manager.go:1196] Started watching for new ooms in manager Jun 09 11:43:23.875500 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.875488 2562 manager.go:349] Starting recovery of all containers Jun 09 11:43:23.882898 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.882658 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:23.884700 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.884680 2562 manager.go:354] Recovery completed Jun 09 11:43:23.885387 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.885366 2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jun 09 11:43:23.890633 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.890616 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:23.892797 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.892779 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:23.892863 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.892817 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:23.892863 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.892828 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:23.893374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.893355 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:43:23.893374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.893367 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:23.893474 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.893368 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:43:23.893474 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.893408 2562 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:43:23.894146 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894132 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:23.894197 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894160 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:23.894197 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894173 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:23.894482 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894471 2562 policy_none.go:49] "None policy: Start" Jun 09 11:43:23.894515 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894487 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:43:23.894515 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.894497 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:43:23.895464 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.895450 2562 policy_none.go:47] "Start" Jun 09 11:43:23.927578 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.927562 2562 manager.go:337] "Starting Device Plugin manager" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.927616 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.927632 2562 server.go:87] "Starting device plugin registration server" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.927939 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.927955 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.928050 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.928145 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.928154 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.928775 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:43:23.940534 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.928833 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:23.941482 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.941455 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:43:23.942900 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.942874 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:43:23.943007 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.942913 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:43:23.943007 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.942938 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:43:23.943007 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:23.942971 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:43:23.945554 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:23.945535 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:24.029052 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.028999 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:24.030268 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.030245 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:24.030363 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.030284 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:24.030363 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.030297 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:24.030363 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.030323 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.040161 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.040095 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.040161 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.040132 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-33.ec2.internal\": node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.043086 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.043060 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal"] Jun 09 11:43:24.043203 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.043140 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:24.044566 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.044537 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:24.044674 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.044584 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:24.044674 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.044598 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:24.045924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.045909 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:24.046065 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.046108 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046086 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:24.046724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046700 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:24.046724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046714 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:24.046890 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046733 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:24.046890 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046738 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:24.046890 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046743 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:24.046890 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.046771 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:24.047910 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.047891 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.047999 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.047922 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:43:24.048673 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.048656 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:43:24.048736 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.048690 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:43:24.048736 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.048706 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:43:24.055511 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.055485 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.072920 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.072896 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.078104 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.078084 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-33.ec2.internal\" not found" node="ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.155956 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.155918 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.175646 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.175614 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.175817 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.175654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.175817 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.175683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3f1a7132c9e3bee9e3dcb2cfeacf2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"a3f1a7132c9e3bee9e3dcb2cfeacf2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.256820 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.256791 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.276201 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276178 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.276287 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276212 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.276287 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276230 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3f1a7132c9e3bee9e3dcb2cfeacf2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"a3f1a7132c9e3bee9e3dcb2cfeacf2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.276356 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276294 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3f1a7132c9e3bee9e3dcb2cfeacf2f7-config\") pod \"kube-apiserver-proxy-ip-10-0-138-33.ec2.internal\" (UID: \"a3f1a7132c9e3bee9e3dcb2cfeacf2f7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.276356 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.276356 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.276310 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb6a3a652ba3805c6697475cf9bc83ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal\" (UID: \"cb6a3a652ba3805c6697475cf9bc83ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.357783 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.357646 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.377034 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.377005 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.382497 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.382471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.458461 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.458399 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.558926 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.558894 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.659580 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.659474 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-33.ec2.internal\" not found" Jun 09 11:43:24.736278 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.736244 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:24.774249 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.774214 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.784238 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.784216 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:43:24.786210 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.786187 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" Jun 09 11:43:24.792999 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.792974 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:24.798280 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.798263 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:43:24.804431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.804412 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:43:24.804574 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.804541 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:43:24.804680 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.804591 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:43:24.804680 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.804594 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:43:24.804680 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.804603 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:43:24.846772 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.846710 2562 apiserver.go:52] "Watching apiserver" Jun 09 11:43:24.862264 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.862232 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:43:24.863350 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.863321 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-tq8w4","openshift-image-registry/node-ca-dgcll","openshift-network-diagnostics/network-check-target-4c5m9","openshift-network-operator/iptables-alerter-lb8hm","openshift-ovn-kubernetes/ovnkube-node-b5vvx","kube-system/global-pull-secret-syncer-gzdxb","kube-system/konnectivity-agent-4ngqc","kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal","openshift-dns/node-resolver-w8xcd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal","openshift-multus/multus-additional-cni-plugins-hp6nb","openshift-multus/multus-ftbrt","openshift-multus/network-metrics-daemon-6qzc6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh"] Jun 09 11:43:24.865963 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.865932 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.868123 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.868101 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.868246 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.868141 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.868246 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.868151 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-55d58\"" Jun 09 11:43:24.868246 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.868142 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.869965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.869947 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nlvjd\"" Jun 09 11:43:24.870081 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.869946 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.870152 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.870139 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:43:24.870212 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.870174 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.870547 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.870529 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:24.870649 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.870591 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:24.872777 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.872731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.873914 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.873897 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:43:24.874712 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874635 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:38:23 +0000 UTC" deadline="2028-01-18 18:26:39.543393412 +0000 UTC" Jun 09 11:43:24.874822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874715 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14118h43m14.668682622s" Jun 09 11:43:24.874880 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.874880 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874830 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:43:24.874880 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874849 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.875044 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874834 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.875044 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.874949 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j9wv9\"" Jun 09 11:43:24.876868 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.876848 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.877088 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:24.877182 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:43:24.877182 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.877157 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:24.877182 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877177 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:43:24.877342 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877192 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:43:24.877342 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877297 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-v4p4c\"" Jun 09 11:43:24.877342 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877340 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.877479 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.877413 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:43:24.879294 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879271 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:24.879566 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879546 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879652 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879588 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879652 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879607 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-modprobe-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.879767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879646 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-var-lib-kubelet\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.879767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf44d\" (UniqueName: \"kubernetes.io/projected/8457144b-cdcc-4d21-95e4-ade541c13200-kube-api-access-lf44d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.879767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879693 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48ba8a37-bcce-4961-838a-ae6f28ff2742-iptables-alerter-script\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.879767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-netns\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879729 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-node-log\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879761 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-log-socket\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879808 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48ba8a37-bcce-4961-838a-ae6f28ff2742-host-slash\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879840 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spnwg\" (UniqueName: \"kubernetes.io/projected/48ba8a37-bcce-4961-838a-ae6f28ff2742-kube-api-access-spnwg\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-ovn\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879910 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-config\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879936 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-conf\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-host\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.879989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.879990 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-systemd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880005 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysconfig\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880019 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-sys\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880035 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880082 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-kubelet\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-systemd-units\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-netd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-lib-modules\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b88fee1-9655-4476-8cd7-c7194a94de17-host\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880219 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-var-lib-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovn-node-metrics-cert\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880271 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-systemd\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880294 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b88fee1-9655-4476-8cd7-c7194a94de17-serviceca\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-slash\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880329 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-bin\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880362 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-env-overrides\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880390 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-script-lib\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.880417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880459 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xwf9\" (UniqueName: \"kubernetes.io/projected/3b88fee1-9655-4476-8cd7-c7194a94de17-kube-api-access-5xwf9\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880498 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-etc-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880532 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mpjk\" (UniqueName: \"kubernetes.io/projected/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-kube-api-access-9mpjk\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880573 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-kubernetes\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-run\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880618 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-etc-tuned\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880642 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-tmp\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.880675 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.881220 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.881220 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:43:24.881315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.881312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7h75x\"" Jun 09 11:43:24.881842 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.881505 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:24.883486 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.883459 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.883577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.883502 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-vngkq\"" Jun 09 11:43:24.883684 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.883579 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.884063 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.884048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.886653 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.886478 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.887371 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.887435 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2grmn\"" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.887504 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.887569 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.887904 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.888041 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:43:24.889180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.888109 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:43:24.889539 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.889302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:43:24.889870 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.889853 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r4svv\"" Jun 09 11:43:24.890025 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.890011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:24.890146 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.890125 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:24.892274 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.892256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.894147 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.894126 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:43:24.894308 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.894292 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:43:24.894358 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.894329 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sqdtq\"" Jun 09 11:43:24.894707 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.894688 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:43:24.912070 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.912011 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdcln" Jun 09 11:43:24.920428 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.920405 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jdcln" Jun 09 11:43:24.975503 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.975457 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:43:24.981380 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981349 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-sys-fs\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.981513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981390 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48ba8a37-bcce-4961-838a-ae6f28ff2742-host-slash\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.981513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spnwg\" (UniqueName: \"kubernetes.io/projected/48ba8a37-bcce-4961-838a-ae6f28ff2742-kube-api-access-spnwg\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.981513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-ovn\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.981513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981471 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/48ba8a37-bcce-4961-838a-ae6f28ff2742-host-slash\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.981513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-conf\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-hostroot\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981525 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-ovn\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981551 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-systemd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981598 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-system-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981621 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981631 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-conf\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981652 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-multus\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-systemd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.981792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-daemon-config\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981791 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-etc-kubernetes\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b66rm\" (UniqueName: \"kubernetes.io/projected/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-kube-api-access-b66rm\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981878 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-systemd-units\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981896 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-netd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b88fee1-9655-4476-8cd7-c7194a94de17-host\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58faefe-c715-469e-b35e-b28c0bba55a7-agent-certs\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981951 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-var-lib-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981954 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-systemd-units\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovn-node-metrics-cert\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.981971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-netd\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982004 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-var-lib-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982003 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b88fee1-9655-4476-8cd7-c7194a94de17-serviceca\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-os-release\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982089 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-dbus\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3b88fee1-9655-4476-8cd7-c7194a94de17-host\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnl6z\" (UniqueName: \"kubernetes.io/projected/0ba521a2-5fb9-495f-935c-d75743fa027b-kube-api-access-bnl6z\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.982263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-env-overrides\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982219 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-script-lib\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xwf9\" (UniqueName: \"kubernetes.io/projected/3b88fee1-9655-4476-8cd7-c7194a94de17-kube-api-access-5xwf9\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982277 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cnibin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982309 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-k8s-cni-cncf-io\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982342 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-device-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982377 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtxd5\" (UniqueName: \"kubernetes.io/projected/6267a89d-c18d-4c13-b516-22ef9a524023-kube-api-access-qtxd5\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-etc-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982501 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-etc-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mpjk\" (UniqueName: \"kubernetes.io/projected/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-kube-api-access-9mpjk\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982536 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3b88fee1-9655-4476-8cd7-c7194a94de17-serviceca\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982558 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-kubernetes\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982590 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-run\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-etc-tuned\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982654 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-conf-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982692 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:43:24.983076 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982726 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-kubernetes\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-run\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982802 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982877 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-netns\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982922 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-os-release\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982953 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48ba8a37-bcce-4961-838a-ae6f28ff2742-iptables-alerter-script\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982963 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-script-lib\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.982918 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983053 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-netns\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983054 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-env-overrides\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983146 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-netns\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983197 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-node-log\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983271 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-log-socket\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983312 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-node-log\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-bin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983363 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-socket-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-log-socket\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.983822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-config\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-host\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983448 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6j44\" (UniqueName: \"kubernetes.io/projected/45100e9a-1edb-470f-80e8-610e52b80030-kube-api-access-p6j44\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983468 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysconfig\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983511 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-host\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-sys\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983537 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/48ba8a37-bcce-4961-838a-ae6f28ff2742-iptables-alerter-script\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983590 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysconfig\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983637 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58faefe-c715-469e-b35e-b28c0bba55a7-konnectivity-ca\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983654 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-sys\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983670 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983722 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-kubelet\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983764 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-lib-modules\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-systemd\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.984577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983814 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f71d7f7-9784-406e-84e6-432a0abafec5-tmp-dir\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983846 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62t4t\" (UniqueName: \"kubernetes.io/projected/6f71d7f7-9784-406e-84e6-432a0abafec5-kube-api-access-62t4t\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983882 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-lib-modules\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983896 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-system-cni-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983897 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovnkube-config\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.983838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-kubelet\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984086 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-systemd\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-slash\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984124 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-bin\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984126 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-slash\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984176 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-kubelet\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984196 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-cni-bin\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f71d7f7-9784-406e-84e6-432a0abafec5-hosts-file\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-cnibin\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-tmp\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985250 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-sysctl-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984321 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-socket-dir-parent\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984379 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-registration-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-kubelet-config\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984437 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984483 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984553 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984584 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984628 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-modprobe-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-var-lib-kubelet\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984664 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-run-openvswitch\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984697 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-host-run-ovn-kubernetes\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf44d\" (UniqueName: \"kubernetes.io/projected/8457144b-cdcc-4d21-95e4-ade541c13200-kube-api-access-lf44d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984771 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-var-lib-kubelet\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984824 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cni-binary-copy\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984738 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8457144b-cdcc-4d21-95e4-ade541c13200-etc-modprobe-d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.985730 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.984858 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-multus-certs\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:24.986269 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.986248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-etc-tuned\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.986305 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.986284 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-ovn-node-metrics-cert\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.986678 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.986659 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8457144b-cdcc-4d21-95e4-ade541c13200-tmp\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:24.989545 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.989506 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:24.989736 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.989695 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:24.989867 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.989856 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:24.990052 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:24.990038 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:25.490016617 +0000 UTC m=+1.990871797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:24.991487 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.991458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xwf9\" (UniqueName: \"kubernetes.io/projected/3b88fee1-9655-4476-8cd7-c7194a94de17-kube-api-access-5xwf9\") pod \"node-ca-dgcll\" (UID: \"3b88fee1-9655-4476-8cd7-c7194a94de17\") " pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:24.991819 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.991802 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spnwg\" (UniqueName: \"kubernetes.io/projected/48ba8a37-bcce-4961-838a-ae6f28ff2742-kube-api-access-spnwg\") pod \"iptables-alerter-lb8hm\" (UID: \"48ba8a37-bcce-4961-838a-ae6f28ff2742\") " pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:24.991937 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.991876 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mpjk\" (UniqueName: \"kubernetes.io/projected/5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c-kube-api-access-9mpjk\") pod \"ovnkube-node-b5vvx\" (UID: \"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c\") " pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:24.993120 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:24.993100 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf44d\" (UniqueName: \"kubernetes.io/projected/8457144b-cdcc-4d21-95e4-ade541c13200-kube-api-access-lf44d\") pod \"tuned-tq8w4\" (UID: \"8457144b-cdcc-4d21-95e4-ade541c13200\") " pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:25.018729 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.018688 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f1a7132c9e3bee9e3dcb2cfeacf2f7.slice/crio-f5993aa254958e3d516849db5c84004dbc57a800b0f64aeb87ba96f7b2b2974f WatchSource:0}: Error finding container f5993aa254958e3d516849db5c84004dbc57a800b0f64aeb87ba96f7b2b2974f: Status 404 returned error can't find the container with id f5993aa254958e3d516849db5c84004dbc57a800b0f64aeb87ba96f7b2b2974f Jun 09 11:43:25.019124 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.019095 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb6a3a652ba3805c6697475cf9bc83ac.slice/crio-eff8497463f9830a27a2ff2742850c4f762da54db746426537c8ca3ee78eb330 WatchSource:0}: Error finding container eff8497463f9830a27a2ff2742850c4f762da54db746426537c8ca3ee78eb330: Status 404 returned error can't find the container with id eff8497463f9830a27a2ff2742850c4f762da54db746426537c8ca3ee78eb330 Jun 09 11:43:25.023625 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.023608 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:43:25.085850 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085809 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:25.085850 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58faefe-c715-469e-b35e-b28c0bba55a7-konnectivity-ca\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085916 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f71d7f7-9784-406e-84e6-432a0abafec5-tmp-dir\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085939 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62t4t\" (UniqueName: \"kubernetes.io/projected/6f71d7f7-9784-406e-84e6-432a0abafec5-kube-api-access-62t4t\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085964 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-etc-selinux\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.085984 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086002 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-system-cni-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.085966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-system-cni-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.086082 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:25.586062093 +0000 UTC m=+2.086917278 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:25.086101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086073 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086126 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-kubelet\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086175 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f71d7f7-9784-406e-84e6-432a0abafec5-hosts-file\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-cnibin\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086270 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-kubelet\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086279 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-cnibin\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6f71d7f7-9784-406e-84e6-432a0abafec5-hosts-file\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086298 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6f71d7f7-9784-406e-84e6-432a0abafec5-tmp-dir\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086352 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-socket-dir-parent\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086382 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-registration-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-kubelet-config\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086447 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086456 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-registration-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086448 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-socket-dir-parent\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086472 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-kubelet-config\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.086516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cni-binary-copy\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086521 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-multus-certs\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-sys-fs\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-hostroot\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086590 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-system-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086658 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-sys-fs\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086659 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-system-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-hostroot\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-cni-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086712 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-multus\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086770 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-multus\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086796 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-daemon-config\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086824 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-etc-kubernetes\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086848 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b66rm\" (UniqueName: \"kubernetes.io/projected/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-kube-api-access-b66rm\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086895 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-etc-kubernetes\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086968 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58faefe-c715-469e-b35e-b28c0bba55a7-agent-certs\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:25.087276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-os-release\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087010 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-multus-certs\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.086969 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ba521a2-5fb9-495f-935c-d75743fa027b-cni-binary-copy\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087074 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-os-release\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087107 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cni-binary-copy\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-dbus\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnl6z\" (UniqueName: \"kubernetes.io/projected/0ba521a2-5fb9-495f-935c-d75743fa027b-kube-api-access-bnl6z\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087196 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cnibin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087220 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-k8s-cni-cncf-io\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087243 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-device-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087270 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtxd5\" (UniqueName: \"kubernetes.io/projected/6267a89d-c18d-4c13-b516-22ef9a524023-kube-api-access-qtxd5\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087280 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/69b2b4f5-5160-438e-a27a-898f05a45442-dbus\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/b58faefe-c715-469e-b35e-b28c0bba55a7-konnectivity-ca\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087309 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-conf-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-k8s-cni-cncf-io\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.087913 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087349 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-daemon-config\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-netns\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087360 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-device-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087335 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-cnibin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087381 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-os-release\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087409 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-multus-conf-dir\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087412 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-run-netns\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087410 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-bin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087450 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-host-var-lib-cni-bin\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-socket-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.087413 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087479 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ba521a2-5fb9-495f-935c-d75743fa027b-os-release\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087483 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6j44\" (UniqueName: \"kubernetes.io/projected/45100e9a-1edb-470f-80e8-610e52b80030-kube-api-access-p6j44\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087526 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-socket-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.087591 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6267a89d-c18d-4c13-b516-22ef9a524023-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.088398 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.087628 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:25.587609862 +0000 UTC m=+2.088465047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:25.089629 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.089607 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/b58faefe-c715-469e-b35e-b28c0bba55a7-agent-certs\") pod \"konnectivity-agent-4ngqc\" (UID: \"b58faefe-c715-469e-b35e-b28c0bba55a7\") " pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:25.095472 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.095437 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62t4t\" (UniqueName: \"kubernetes.io/projected/6f71d7f7-9784-406e-84e6-432a0abafec5-kube-api-access-62t4t\") pod \"node-resolver-w8xcd\" (UID: \"6f71d7f7-9784-406e-84e6-432a0abafec5\") " pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.095912 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.095887 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnl6z\" (UniqueName: \"kubernetes.io/projected/0ba521a2-5fb9-495f-935c-d75743fa027b-kube-api-access-bnl6z\") pod \"multus-additional-cni-plugins-hp6nb\" (UID: \"0ba521a2-5fb9-495f-935c-d75743fa027b\") " pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.096180 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.096160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6j44\" (UniqueName: \"kubernetes.io/projected/45100e9a-1edb-470f-80e8-610e52b80030-kube-api-access-p6j44\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:25.096790 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.096772 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b66rm\" (UniqueName: \"kubernetes.io/projected/f6b58977-15ff-4a8d-b9c0-01eff0e7abec-kube-api-access-b66rm\") pod \"multus-ftbrt\" (UID: \"f6b58977-15ff-4a8d-b9c0-01eff0e7abec\") " pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.097040 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.097024 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtxd5\" (UniqueName: \"kubernetes.io/projected/6267a89d-c18d-4c13-b516-22ef9a524023-kube-api-access-qtxd5\") pod \"aws-ebs-csi-driver-node-2wfdh\" (UID: \"6267a89d-c18d-4c13-b516-22ef9a524023\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.187221 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.187132 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" Jun 09 11:43:25.197570 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.197533 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8457144b_cdcc_4d21_95e4_ade541c13200.slice/crio-87c12a6aa60707c3d71560c7c351969b8f3a075bf8b191d74269bde8ee6fe804 WatchSource:0}: Error finding container 87c12a6aa60707c3d71560c7c351969b8f3a075bf8b191d74269bde8ee6fe804: Status 404 returned error can't find the container with id 87c12a6aa60707c3d71560c7c351969b8f3a075bf8b191d74269bde8ee6fe804 Jun 09 11:43:25.212145 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.212117 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dgcll" Jun 09 11:43:25.221257 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.221214 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b88fee1_9655_4476_8cd7_c7194a94de17.slice/crio-f3fb58380b2a53138914769fafb14b9aaeb04ee2c560b2c6290bffc98eb27242 WatchSource:0}: Error finding container f3fb58380b2a53138914769fafb14b9aaeb04ee2c560b2c6290bffc98eb27242: Status 404 returned error can't find the container with id f3fb58380b2a53138914769fafb14b9aaeb04ee2c560b2c6290bffc98eb27242 Jun 09 11:43:25.230065 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.230041 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lb8hm" Jun 09 11:43:25.240718 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.240696 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:25.250009 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.249982 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a97a376_eef8_4e9f_8c9f_6ed9ec7b589c.slice/crio-8fa2ef6a58ce7b0bc883a21b2478d49a9deacfa95f163e1179afb6b6e8c8340e WatchSource:0}: Error finding container 8fa2ef6a58ce7b0bc883a21b2478d49a9deacfa95f163e1179afb6b6e8c8340e: Status 404 returned error can't find the container with id 8fa2ef6a58ce7b0bc883a21b2478d49a9deacfa95f163e1179afb6b6e8c8340e Jun 09 11:43:25.257793 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.257769 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:25.266678 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.266648 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb58faefe_c715_469e_b35e_b28c0bba55a7.slice/crio-33d2e61266d4b83942fe7d73ec795c6b75b20b735af340e9b4a8fdbf83ff3e1e WatchSource:0}: Error finding container 33d2e61266d4b83942fe7d73ec795c6b75b20b735af340e9b4a8fdbf83ff3e1e: Status 404 returned error can't find the container with id 33d2e61266d4b83942fe7d73ec795c6b75b20b735af340e9b4a8fdbf83ff3e1e Jun 09 11:43:25.272012 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.271991 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w8xcd" Jun 09 11:43:25.280952 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.280929 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f71d7f7_9784_406e_84e6_432a0abafec5.slice/crio-3a43b37e27d4eb92c60b40125f7ced81bc6dc54825462d3623e7f8d0ebff6bc8 WatchSource:0}: Error finding container 3a43b37e27d4eb92c60b40125f7ced81bc6dc54825462d3623e7f8d0ebff6bc8: Status 404 returned error can't find the container with id 3a43b37e27d4eb92c60b40125f7ced81bc6dc54825462d3623e7f8d0ebff6bc8 Jun 09 11:43:25.300659 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.300621 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" Jun 09 11:43:25.305526 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.305499 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-ftbrt" Jun 09 11:43:25.310978 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.310949 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba521a2_5fb9_495f_935c_d75743fa027b.slice/crio-744373a22fb12b279f7ff23d1ed8476a072f6e6f329fa2eb27e05a960d35ab23 WatchSource:0}: Error finding container 744373a22fb12b279f7ff23d1ed8476a072f6e6f329fa2eb27e05a960d35ab23: Status 404 returned error can't find the container with id 744373a22fb12b279f7ff23d1ed8476a072f6e6f329fa2eb27e05a960d35ab23 Jun 09 11:43:25.313384 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.313283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" Jun 09 11:43:25.314969 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.314946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6b58977_15ff_4a8d_b9c0_01eff0e7abec.slice/crio-3be770ce3f20c16a1e6d2ce285e110f023ce3d3313d73a8229d952f6cc74074a WatchSource:0}: Error finding container 3be770ce3f20c16a1e6d2ce285e110f023ce3d3313d73a8229d952f6cc74074a: Status 404 returned error can't find the container with id 3be770ce3f20c16a1e6d2ce285e110f023ce3d3313d73a8229d952f6cc74074a Jun 09 11:43:25.323153 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:43:25.323122 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6267a89d_c18d_4c13_b516_22ef9a524023.slice/crio-7b085b45bc7e81227a22ca8d3b9cdff16a5f80861a4293e5c401f91cb6b6c6c2 WatchSource:0}: Error finding container 7b085b45bc7e81227a22ca8d3b9cdff16a5f80861a4293e5c401f91cb6b6c6c2: Status 404 returned error can't find the container with id 7b085b45bc7e81227a22ca8d3b9cdff16a5f80861a4293e5c401f91cb6b6c6c2 Jun 09 11:43:25.589945 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.589858 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:25.589945 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.589919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:25.590161 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.589955 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:25.590161 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590068 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:25.590161 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590134 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:26.590113127 +0000 UTC m=+3.090968307 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:25.590328 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590221 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:25.590328 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590234 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:25.590328 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590248 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:25.590328 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590285 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:26.590273515 +0000 UTC m=+3.091128696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:25.590529 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590356 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:25.590529 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:25.590390 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:26.590379412 +0000 UTC m=+3.091234592 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:25.819226 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.819192 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:25.924471 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.924142 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:38:24 +0000 UTC" deadline="2027-11-05 10:51:03.094626283 +0000 UTC" Jun 09 11:43:25.924471 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.924420 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12335h7m37.170211391s" Jun 09 11:43:25.986242 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.986101 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ngqc" event={"ID":"b58faefe-c715-469e-b35e-b28c0bba55a7","Type":"ContainerStarted","Data":"33d2e61266d4b83942fe7d73ec795c6b75b20b735af340e9b4a8fdbf83ff3e1e"} Jun 09 11:43:25.999053 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:25.998896 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"8fa2ef6a58ce7b0bc883a21b2478d49a9deacfa95f163e1179afb6b6e8c8340e"} Jun 09 11:43:26.015729 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.015685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lb8hm" event={"ID":"48ba8a37-bcce-4961-838a-ae6f28ff2742","Type":"ContainerStarted","Data":"11299e19c34ef2e420abc29b5740fe151a62c093b449869cccd82fdfddfbae82"} Jun 09 11:43:26.036423 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.036331 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dgcll" event={"ID":"3b88fee1-9655-4476-8cd7-c7194a94de17","Type":"ContainerStarted","Data":"f3fb58380b2a53138914769fafb14b9aaeb04ee2c560b2c6290bffc98eb27242"} Jun 09 11:43:26.059916 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.059873 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" event={"ID":"8457144b-cdcc-4d21-95e4-ade541c13200","Type":"ContainerStarted","Data":"87c12a6aa60707c3d71560c7c351969b8f3a075bf8b191d74269bde8ee6fe804"} Jun 09 11:43:26.095501 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.095388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"cb6a3a652ba3805c6697475cf9bc83ac","Type":"ContainerStarted","Data":"eff8497463f9830a27a2ff2742850c4f762da54db746426537c8ca3ee78eb330"} Jun 09 11:43:26.114167 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.114125 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"a3f1a7132c9e3bee9e3dcb2cfeacf2f7","Type":"ContainerStarted","Data":"f5993aa254958e3d516849db5c84004dbc57a800b0f64aeb87ba96f7b2b2974f"} Jun 09 11:43:26.134320 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.134181 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" event={"ID":"6267a89d-c18d-4c13-b516-22ef9a524023","Type":"ContainerStarted","Data":"7b085b45bc7e81227a22ca8d3b9cdff16a5f80861a4293e5c401f91cb6b6c6c2"} Jun 09 11:43:26.153157 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.153030 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftbrt" event={"ID":"f6b58977-15ff-4a8d-b9c0-01eff0e7abec","Type":"ContainerStarted","Data":"3be770ce3f20c16a1e6d2ce285e110f023ce3d3313d73a8229d952f6cc74074a"} Jun 09 11:43:26.155703 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.155606 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerStarted","Data":"744373a22fb12b279f7ff23d1ed8476a072f6e6f329fa2eb27e05a960d35ab23"} Jun 09 11:43:26.170125 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.170031 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8xcd" event={"ID":"6f71d7f7-9784-406e-84e6-432a0abafec5","Type":"ContainerStarted","Data":"3a43b37e27d4eb92c60b40125f7ced81bc6dc54825462d3623e7f8d0ebff6bc8"} Jun 09 11:43:26.291032 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.290689 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.600094 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.600153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.600203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600355 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600376 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600397 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600456 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:28.60043727 +0000 UTC m=+5.101292455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600872 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600923 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:28.600907659 +0000 UTC m=+5.101762839 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.600979 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:26.601122 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.601012 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:28.601001487 +0000 UTC m=+5.101856672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:26.925460 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.925332 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:38:24 +0000 UTC" deadline="2027-12-16 06:55:57.424171154 +0000 UTC" Jun 09 11:43:26.925460 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.925374 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13315h12m30.498801829s" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.943507 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.943656 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.944088 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.944202 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:26.944268 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:26.944401 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:26.944335 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:27.498162 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:27.498123 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:27.545179 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:27.544867 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:43:28.622260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.622221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:28.622786 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.622294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:28.622786 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.622336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:28.622786 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.622541 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:28.622786 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.622612 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:32.622592415 +0000 UTC m=+9.123447589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:28.623077 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623052 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:28.623157 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623079 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:28.623157 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623093 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:28.623157 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623141 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:32.623124845 +0000 UTC m=+9.123980012 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:28.623313 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623202 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:28.623313 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.623241 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:32.623227712 +0000 UTC m=+9.124082895 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:28.943618 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.943251 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:28.943618 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.943406 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:28.943618 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.943399 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:28.943618 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.943526 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:28.944135 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:28.943964 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:28.944135 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:28.944079 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:30.943329 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:30.943239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:30.943329 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:30.943280 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:30.943329 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:30.943279 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:30.943936 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:30.943382 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:30.943936 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:30.943518 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:30.943936 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:30.943602 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:32.658552 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.658516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.658577 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.658610 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658707 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658730 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658734 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658769 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658823 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:40.658800368 +0000 UTC m=+17.159655548 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658844 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:40.65883387 +0000 UTC m=+17.159689036 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658859 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:32.659050 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.658917 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:40.658898616 +0000 UTC m=+17.159753798 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:32.944963 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.944882 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:32.945131 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.945028 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:32.945714 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.945424 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:32.945714 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.945553 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:32.945714 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:32.945602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:32.945714 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:32.945670 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:34.943984 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:34.943951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:34.944407 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:34.944011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:34.944407 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:34.944169 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:34.944407 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:34.944189 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:34.944407 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:34.944288 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:34.944407 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:34.944367 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:36.944260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:36.944215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:36.944260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:36.944248 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:36.944260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:36.944215 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:36.944807 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:36.944354 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:36.944807 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:36.944442 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:36.944807 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:36.944474 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:38.943569 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:38.943528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:38.944060 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:38.943528 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:38.944060 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:38.943677 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:38.944060 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:38.943533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:38.944060 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:38.943777 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:38.944060 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:38.943824 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:40.721723 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.721683 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.721762 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.721810 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721883 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721929 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721934 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721947 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721959 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.721974 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:56.721951746 +0000 UTC m=+33.222806926 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.722006 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:43:56.721989936 +0000 UTC m=+33.222845116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:40.722243 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.722025 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:43:56.722014877 +0000 UTC m=+33.222870046 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:40.943239 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.943196 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:40.943409 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.943264 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:40.943409 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:40.943263 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:40.943409 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.943348 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:40.943507 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.943470 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:40.943598 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:40.943576 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:42.943974 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:42.943933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:42.944491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:42.943994 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:42.944491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:42.943953 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:42.944491 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:42.944063 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:42.944491 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:42.944132 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:42.944491 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:42.944209 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:44.944149 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:44.944113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:44.944638 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:44.944113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:44.944638 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:44.944272 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:44.944638 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:44.944113 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:44.944638 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:44.944324 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:44.944638 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:44.944445 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:46.220989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.220609 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-ftbrt" event={"ID":"f6b58977-15ff-4a8d-b9c0-01eff0e7abec","Type":"ContainerStarted","Data":"21a55d3be51d7deec6ba39c082556756d6fd43a9b42384c0525f06b40c5c4a62"} Jun 09 11:43:46.224413 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:43:46.224814 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224782 2562 generic.go:356] "Generic (PLEG): container finished" podID="5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c" containerID="1843548dc670516ddff3c0937c4f9a4929ccbbf113db53b2542c5b164f5faf25" exitCode=1 Jun 09 11:43:46.224921 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224869 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"3cbe209795dcf2db161e8817c35fb1b9e48f246c26576dde19038054235c0079"} Jun 09 11:43:46.224971 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224931 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"43018bcef3a11eec60a8e55f0175b8c5001b295c0fc79cc41e42de0519c79970"} Jun 09 11:43:46.224971 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224959 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerDied","Data":"1843548dc670516ddff3c0937c4f9a4929ccbbf113db53b2542c5b164f5faf25"} Jun 09 11:43:46.225050 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.224989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"69c0e5d4adf9deba8d41e3256539d6592868254c00190d423f1d56d2100e64f0"} Jun 09 11:43:46.226281 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.226265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" event={"ID":"8457144b-cdcc-4d21-95e4-ade541c13200","Type":"ContainerStarted","Data":"ae5de30940ad9ef051504e87d76eee0c5c3d1c1755fe42ed53a99a452d3dbe10"} Jun 09 11:43:46.227615 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.227595 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" event={"ID":"a3f1a7132c9e3bee9e3dcb2cfeacf2f7","Type":"ContainerStarted","Data":"ef6e9aa67d5a77fa907057d46e121da38514373ec6464fe219831d2d9e5dabb5"} Jun 09 11:43:46.237846 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.237802 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-ftbrt" podStartSLOduration=1.986788137 podStartE2EDuration="22.237790291s" totalImagesPullingTime="20.251002154s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:46.23740703 +0000 UTC m=+22.738262220" watchObservedRunningTime="2026-06-09 11:43:46.237790291 +0000 UTC m=+22.738645479" Jun 09 11:43:46.252253 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.252209 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-33.ec2.internal" podStartSLOduration=22.252192181 podStartE2EDuration="22.252192181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:46.251465116 +0000 UTC m=+22.752320317" watchObservedRunningTime="2026-06-09 11:43:46.252192181 +0000 UTC m=+22.753047369" Jun 09 11:43:46.270103 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.270054 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-tq8w4" podStartSLOduration=1.9701030099999999 podStartE2EDuration="22.27003855s" totalImagesPullingTime="20.29993554s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:46.26969143 +0000 UTC m=+22.770546617" watchObservedRunningTime="2026-06-09 11:43:46.27003855 +0000 UTC m=+22.770893738" Jun 09 11:43:46.943424 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.943136 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:46.943424 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.943137 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:46.943609 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:46.943436 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:46.943609 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:46.943195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:46.943609 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:46.943504 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:46.943711 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:46.943618 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:47.231985 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.231944 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dgcll" event={"ID":"3b88fee1-9655-4476-8cd7-c7194a94de17","Type":"ContainerStarted","Data":"8a76fa2c6cf854f6b2de38bb277e095ac3ee2dfce3434b0fa8c18124133275e4"} Jun 09 11:43:47.233876 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.233836 2562 generic.go:356] "Generic (PLEG): container finished" podID="cb6a3a652ba3805c6697475cf9bc83ac" containerID="cf64fff6e0094aa85ab33040cf0aa21f9aa0ed774b1b844806a7e8404e027e0d" exitCode=0 Jun 09 11:43:47.234032 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.233958 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"cb6a3a652ba3805c6697475cf9bc83ac","Type":"ContainerDied","Data":"cf64fff6e0094aa85ab33040cf0aa21f9aa0ed774b1b844806a7e8404e027e0d"} Jun 09 11:43:47.238507 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.238479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" event={"ID":"6267a89d-c18d-4c13-b516-22ef9a524023","Type":"ContainerStarted","Data":"8a1f46ed166548ba505b120c25533bd33de80d4eacaf9c4ca98260e4b1596da3"} Jun 09 11:43:47.240514 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.240485 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="364f076fe47e3afb837ccb215791e3f16db04b38339e777bb0b993da637b7733" exitCode=0 Jun 09 11:43:47.240659 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.240593 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"364f076fe47e3afb837ccb215791e3f16db04b38339e777bb0b993da637b7733"} Jun 09 11:43:47.242116 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.242086 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w8xcd" event={"ID":"6f71d7f7-9784-406e-84e6-432a0abafec5","Type":"ContainerStarted","Data":"5cb8b96fe4266baa95ccda8059802885828d68c9adb80614b2f9043962f8d467"} Jun 09 11:43:47.244271 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.244045 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4ngqc" event={"ID":"b58faefe-c715-469e-b35e-b28c0bba55a7","Type":"ContainerStarted","Data":"c0c287b062af9b90cf1e6fe509368f9ea8309c2de96f2ac52a9ba644485871ea"} Jun 09 11:43:47.247063 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.247043 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:43:47.247183 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.247139 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dgcll" podStartSLOduration=2.951331899 podStartE2EDuration="23.247126482s" totalImagesPullingTime="20.295794583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:47.246702667 +0000 UTC m=+23.747557855" watchObservedRunningTime="2026-06-09 11:43:47.247126482 +0000 UTC m=+23.747981669" Jun 09 11:43:47.247494 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.247461 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"a508c878356083fe953a78d0e2a2eb259a9eeb43730563e8c26d9889b0ff8772"} Jun 09 11:43:47.247599 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.247544 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"9af3f6f509c5858533b22f97d85af06108f7ab563d86765802320df76989948f"} Jun 09 11:43:47.249561 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.249539 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lb8hm" event={"ID":"48ba8a37-bcce-4961-838a-ae6f28ff2742","Type":"ContainerStarted","Data":"ea2215efc39d9eef02e8f17794e28e1fa8997b7218766f48a2a0ee494a4adff9"} Jun 09 11:43:47.299829 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.299774 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4ngqc" podStartSLOduration=3.040471354 podStartE2EDuration="23.299739822s" totalImagesPullingTime="20.259268468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:47.285146716 +0000 UTC m=+23.786001925" watchObservedRunningTime="2026-06-09 11:43:47.299739822 +0000 UTC m=+23.800595010" Jun 09 11:43:47.300017 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.299902 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w8xcd" podStartSLOduration=3.051873137 podStartE2EDuration="23.299895215s" totalImagesPullingTime="20.248022078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:47.299405046 +0000 UTC m=+23.800260259" watchObservedRunningTime="2026-06-09 11:43:47.299895215 +0000 UTC m=+23.800750404" Jun 09 11:43:47.327051 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.327005 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lb8hm" podStartSLOduration=3.069484502 podStartE2EDuration="23.326987305s" totalImagesPullingTime="20.257502803s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:47.326761477 +0000 UTC m=+23.827616658" watchObservedRunningTime="2026-06-09 11:43:47.326987305 +0000 UTC m=+23.827842514" Jun 09 11:43:47.346525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.346474 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:47.447976 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.447939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:47.508862 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.508723 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:47.601848 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.601812 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:47.664567 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.664534 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:47.898714 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.898688 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:43:47.942611 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.942469 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:43:47.898707114Z","UUID":"7260f1a3-8327-41ae-8f28-f0e270013e95","Handler":null,"Name":"","Endpoint":""} Jun 09 11:43:47.944439 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.944411 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:43:47.944573 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:47.944458 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:43:48.254300 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.254254 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" event={"ID":"cb6a3a652ba3805c6697475cf9bc83ac","Type":"ContainerStarted","Data":"4be81abbff92319a2883b3ab7f12a89613c17abe479c7e7c26dd26bd7ff446bc"} Jun 09 11:43:48.256582 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.256550 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" event={"ID":"6267a89d-c18d-4c13-b516-22ef9a524023","Type":"ContainerStarted","Data":"a4b3db0f987cf051ac5c7254994af18443664e5a5c631207ace157df72891c53"} Jun 09 11:43:48.273108 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.273036 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-33.ec2.internal" podStartSLOduration=24.273016479 podStartE2EDuration="24.273016479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:48.272816431 +0000 UTC m=+24.773671644" watchObservedRunningTime="2026-06-09 11:43:48.273016479 +0000 UTC m=+24.773871670" Jun 09 11:43:48.943316 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.943286 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:48.943536 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.943290 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:48.943536 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:48.943416 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:48.943536 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:48.943471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:48.943664 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:48.943540 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:48.943664 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:48.943612 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:49.263341 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:49.263175 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:43:49.263828 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:49.263684 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"563f3dfafcbc1556ce7021cfaeba95bc0a515808d339d1304370b10ff6c9d687"} Jun 09 11:43:50.268516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.268477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" event={"ID":"6267a89d-c18d-4c13-b516-22ef9a524023","Type":"ContainerStarted","Data":"39cc2b1cfd4b4c8d21273fd46280008e29d5ae524822c396b87995e81c725186"} Jun 09 11:43:50.288445 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.288385 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2wfdh" podStartSLOduration=3.915643897 podStartE2EDuration="26.288363634s" totalImagesPullingTime="22.372719737s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:50.287401417 +0000 UTC m=+26.788256606" watchObservedRunningTime="2026-06-09 11:43:50.288363634 +0000 UTC m=+26.789218823" Jun 09 11:43:50.674254 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.674167 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:50.674814 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.674792 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:50.943412 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.943331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:50.943576 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.943330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:50.943576 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:50.943453 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:50.943576 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:50.943330 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:50.943576 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:50.943526 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:50.943776 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:50.943606 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:52.275316 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.275273 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="cb852f848237232208a6ed655b72215bd831292a0afd8c9c577833a85278427d" exitCode=0 Jun 09 11:43:52.276011 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.275337 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"cb852f848237232208a6ed655b72215bd831292a0afd8c9c577833a85278427d"} Jun 09 11:43:52.279031 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.278951 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:43:52.279369 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.279341 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"711e70987ba98a85a6c33ce4369b3492b46df30b25f56d735dce0de544ca6125"} Jun 09 11:43:52.279558 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.279541 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:52.279628 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.279613 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:52.279821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.279803 2562 scope.go:117] "RemoveContainer" containerID="1843548dc670516ddff3c0937c4f9a4929ccbbf113db53b2542c5b164f5faf25" Jun 09 11:43:52.296877 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.296851 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:52.576212 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.576130 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:52.636267 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.636234 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:52.943507 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.943422 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:52.943507 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.943448 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:52.943803 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:52.943422 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:52.943803 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:52.943562 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:52.943803 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:52.943613 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:52.943803 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:52.943671 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:53.285699 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.285659 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:43:53.286205 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.286131 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" event={"ID":"5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c","Type":"ContainerStarted","Data":"335dd8a8a2a2f5335f691ff8c197d3a49dcb26a976b7c66cd7dcf911510492b8"} Jun 09 11:43:53.286520 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.286499 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:53.303126 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.303098 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:43:53.387107 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.387045 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" podStartSLOduration=8.900478823 podStartE2EDuration="29.387020745s" totalImagesPullingTime="20.486541922s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:43:53.337477522 +0000 UTC m=+29.838332709" watchObservedRunningTime="2026-06-09 11:43:53.387020745 +0000 UTC m=+29.887875933" Jun 09 11:43:53.609446 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.609275 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzdxb"] Jun 09 11:43:53.609644 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.609566 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:53.609776 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:53.609660 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:53.612834 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.612793 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4c5m9"] Jun 09 11:43:53.612989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.612919 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:53.613094 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:53.613043 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:53.613461 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.613438 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qzc6"] Jun 09 11:43:53.613555 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.613541 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:53.613640 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:53.613623 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:53.850881 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.850790 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:53.851049 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.850920 2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 11:43:53.851424 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.851399 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4ngqc" Jun 09 11:43:53.944590 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:53.944552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:43:54.290471 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:54.290433 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="1ce2050703bd1c18c2c298fb8e81500adc495907a1efd97ae4a888491103573c" exitCode=0 Jun 09 11:43:54.290989 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:54.290510 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"1ce2050703bd1c18c2c298fb8e81500adc495907a1efd97ae4a888491103573c"} Jun 09 11:43:54.943638 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:54.943602 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:54.943867 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:54.943726 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:54.943867 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:54.943772 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:54.943989 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:54.943874 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:55.294952 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:55.294918 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="ea6f8a2e1743cad4b26aab2f1ad4335538e63c583c565726d0ae0c6af69180d7" exitCode=0 Jun 09 11:43:55.295450 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:55.294993 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"ea6f8a2e1743cad4b26aab2f1ad4335538e63c583c565726d0ae0c6af69180d7"} Jun 09 11:43:55.943305 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:55.943224 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:55.943466 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:55.943343 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:56.745649 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:56.745614 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:56.745679 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:56.745727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745830 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745892 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745905 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745909 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:44:28.745886445 +0000 UTC m=+65.246741617 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745915 2562 projected.go:196] Error preparing data for projected volume kube-api-access-g7w9x for pod openshift-network-diagnostics/network-check-target-4c5m9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745962 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x podName:70594268-f6c1-47b6-b209-4dda25f8d6ab nodeName:}" failed. No retries permitted until 2026-06-09 11:44:28.745944574 +0000 UTC m=+65.246799744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-g7w9x" (UniqueName: "kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x") pod "network-check-target-4c5m9" (UID: "70594268-f6c1-47b6-b209-4dda25f8d6ab") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745838 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:56.746298 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.745997 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret podName:69b2b4f5-5160-438e-a27a-898f05a45442 nodeName:}" failed. No retries permitted until 2026-06-09 11:44:28.745990495 +0000 UTC m=+65.246845684 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret") pod "global-pull-secret-syncer-gzdxb" (UID: "69b2b4f5-5160-438e-a27a-898f05a45442") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:43:56.944005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:56.943968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:56.944005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:56.944004 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:56.944239 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.944107 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:56.944285 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:56.944239 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:57.943847 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:57.943761 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:57.944247 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:57.943873 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gzdxb" podUID="69b2b4f5-5160-438e-a27a-898f05a45442" Jun 09 11:43:58.944109 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:58.944070 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:43:58.944588 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:58.944227 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:43:58.944588 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:58.944283 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:43:58.944588 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:43:58.944393 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4c5m9" podUID="70594268-f6c1-47b6-b209-4dda25f8d6ab" Jun 09 11:43:59.866258 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.866171 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-33.ec2.internal" event="NodeReady" Jun 09 11:43:59.866398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.866311 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:43:59.911403 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.911368 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6vhbc"] Jun 09 11:43:59.913262 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.913239 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:43:59.917099 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.917030 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:43:59.917352 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.917326 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:43:59.917462 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.917426 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkvst\"" Jun 09 11:43:59.918248 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.918225 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-48qdm"] Jun 09 11:43:59.920710 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.920695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:43:59.923036 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.923011 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:43:59.923036 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.923034 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:43:59.923182 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.923020 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-cs7lp\"" Jun 09 11:43:59.923182 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.923061 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:43:59.924818 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.924799 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vhbc"] Jun 09 11:43:59.930820 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.930796 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48qdm"] Jun 09 11:43:59.943488 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.943458 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:43:59.945819 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:43:59.945796 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:44:00.039627 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.039581 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:00.065225 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-config-volume\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.065334 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065236 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622abbef-221f-479b-bca1-cd2e3e2eff02-cert\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.065334 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065258 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr847\" (UniqueName: \"kubernetes.io/projected/622abbef-221f-479b-bca1-cd2e3e2eff02-kube-api-access-rr847\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.065409 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065355 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-tmp-dir\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.065409 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065400 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.065482 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.065418 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57sh6\" (UniqueName: \"kubernetes.io/projected/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-kube-api-access-57sh6\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.091473 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.091442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:00.166138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166060 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-config-volume\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.166138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622abbef-221f-479b-bca1-cd2e3e2eff02-cert\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.166138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166125 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr847\" (UniqueName: \"kubernetes.io/projected/622abbef-221f-479b-bca1-cd2e3e2eff02-kube-api-access-rr847\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.166388 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-tmp-dir\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.166388 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.166388 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57sh6\" (UniqueName: \"kubernetes.io/projected/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-kube-api-access-57sh6\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.166495 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:00.166464 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:00.166539 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166515 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-tmp-dir\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.166574 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:00.166543 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:00.666520542 +0000 UTC m=+37.167375721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:00.166742 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.166719 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-config-volume\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.170606 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.170485 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/622abbef-221f-479b-bca1-cd2e3e2eff02-cert\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.174960 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.174931 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57sh6\" (UniqueName: \"kubernetes.io/projected/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-kube-api-access-57sh6\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.175069 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.175030 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr847\" (UniqueName: \"kubernetes.io/projected/622abbef-221f-479b-bca1-cd2e3e2eff02-kube-api-access-rr847\") pod \"ingress-canary-48qdm\" (UID: \"622abbef-221f-479b-bca1-cd2e3e2eff02\") " pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.231780 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.231725 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-48qdm" Jun 09 11:44:00.311411 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.311377 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="00d5b839ec92c952d82ecb2b210d687dcdb7941c548b5943c6ca038ff122bf46" exitCode=0 Jun 09 11:44:00.311579 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.311442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"00d5b839ec92c952d82ecb2b210d687dcdb7941c548b5943c6ca038ff122bf46"} Jun 09 11:44:00.381695 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.381649 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-48qdm"] Jun 09 11:44:00.385573 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:44:00.385547 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622abbef_221f_479b_bca1_cd2e3e2eff02.slice/crio-61dc3a9c4c96aa2e5af5422b67ebcae90092195d8a02b8ae77b936162d457786 WatchSource:0}: Error finding container 61dc3a9c4c96aa2e5af5422b67ebcae90092195d8a02b8ae77b936162d457786: Status 404 returned error can't find the container with id 61dc3a9c4c96aa2e5af5422b67ebcae90092195d8a02b8ae77b936162d457786 Jun 09 11:44:00.670542 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.670442 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:00.670684 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:00.670600 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:00.670684 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:00.670665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:01.670648721 +0000 UTC m=+38.171503889 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:00.943626 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.943534 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:44:00.943626 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.943592 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:44:00.946276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.946242 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:44:00.946743 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.946283 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:44:00.946743 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.946242 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf68m\"" Jun 09 11:44:00.946743 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.946364 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5vz2\"" Jun 09 11:44:00.946743 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:00.946258 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:44:01.316440 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:01.316398 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48qdm" event={"ID":"622abbef-221f-479b-bca1-cd2e3e2eff02","Type":"ContainerStarted","Data":"61dc3a9c4c96aa2e5af5422b67ebcae90092195d8a02b8ae77b936162d457786"} Jun 09 11:44:01.321627 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:01.321578 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ba521a2-5fb9-495f-935c-d75743fa027b" containerID="498c6d41bc19ba39d7dbbfcd26d83eed67a221bf338f5c7fda7c3ea4d6eaff12" exitCode=0 Jun 09 11:44:01.321627 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:01.321628 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerDied","Data":"498c6d41bc19ba39d7dbbfcd26d83eed67a221bf338f5c7fda7c3ea4d6eaff12"} Jun 09 11:44:01.679997 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:01.679696 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:01.679997 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:01.679881 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:01.680247 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:01.680052 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:03.680032329 +0000 UTC m=+40.180887496 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:02.325139 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.325041 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-48qdm" event={"ID":"622abbef-221f-479b-bca1-cd2e3e2eff02","Type":"ContainerStarted","Data":"610836147b68e0fa5da5c592d5aec2ce462fa6e9fa9d55f2a9c3b51a503b9746"} Jun 09 11:44:02.328695 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.328669 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" event={"ID":"0ba521a2-5fb9-495f-935c-d75743fa027b","Type":"ContainerStarted","Data":"2b75762974f0de3da3a6ac558ad596edbd604d2a3bf9766718af1b6159ada28f"} Jun 09 11:44:02.340100 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.340050 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-48qdm" podStartSLOduration=1.733485896 podStartE2EDuration="3.340035142s" totalImagesPullingTime="1.606549246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:44:02.339131961 +0000 UTC m=+38.839987149" watchObservedRunningTime="2026-06-09 11:44:02.340035142 +0000 UTC m=+38.840890331" Jun 09 11:44:02.365062 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.365001 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-hp6nb" podStartSLOduration=7.453340375 podStartE2EDuration="38.364977851s" totalImagesPullingTime="30.911637476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:44:02.363485592 +0000 UTC m=+38.864340779" watchObservedRunningTime="2026-06-09 11:44:02.364977851 +0000 UTC m=+38.865833039" Jun 09 11:44:02.487349 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.487310 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:02.555870 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.555833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:02.847189 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.847158 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:02.904586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:02.904547 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:03.697319 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:03.697263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:03.697855 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:03.697422 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:03.697855 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:03.697494 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:07.697476975 +0000 UTC m=+44.198332140 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:07.244910 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:07.244876 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:07.299162 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:07.299109 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:07.729266 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:07.729232 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:07.729449 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:07.729403 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:07.729498 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:07.729473 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:15.729454815 +0000 UTC m=+52.230309981 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:15.786693 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:15.786643 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:15.787276 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:15.786809 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:15.787276 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:15.786880 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:44:31.786860934 +0000 UTC m=+68.287716099 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:25.309548 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:25.309517 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-b5vvx" Jun 09 11:44:25.425974 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:25.425939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:25.526830 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:25.526797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:25.580806 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:25.580694 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:44:28.772595 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.772547 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:44:28.772595 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.772599 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:44:28.773106 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.772638 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:44:28.774960 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.774939 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:44:28.775214 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.775197 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:44:28.775252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.775207 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:44:28.782945 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:28.782913 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:44:28.783070 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:28.782980 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:32.782962778 +0000 UTC m=+129.283817944 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : secret "metrics-daemon-secret" not found Jun 09 11:44:28.785048 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.785030 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:44:28.786869 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.786846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/69b2b4f5-5160-438e-a27a-898f05a45442-original-pull-secret\") pod \"global-pull-secret-syncer-gzdxb\" (UID: \"69b2b4f5-5160-438e-a27a-898f05a45442\") " pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:44:28.795493 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.795463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7w9x\" (UniqueName: \"kubernetes.io/projected/70594268-f6c1-47b6-b209-4dda25f8d6ab-kube-api-access-g7w9x\") pod \"network-check-target-4c5m9\" (UID: \"70594268-f6c1-47b6-b209-4dda25f8d6ab\") " pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:44:28.864651 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.864618 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5vz2\"" Jun 09 11:44:28.873281 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:28.873255 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:44:29.007511 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:29.007476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4c5m9"] Jun 09 11:44:29.011635 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:44:29.011601 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70594268_f6c1_47b6_b209_4dda25f8d6ab.slice/crio-fbc4e0b584b4eeb4e0717fba37a9fbca07032fc30e9e238c31d431aa13359091 WatchSource:0}: Error finding container fbc4e0b584b4eeb4e0717fba37a9fbca07032fc30e9e238c31d431aa13359091: Status 404 returned error can't find the container with id fbc4e0b584b4eeb4e0717fba37a9fbca07032fc30e9e238c31d431aa13359091 Jun 09 11:44:29.053166 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:29.053076 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gzdxb" Jun 09 11:44:29.181031 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:29.180998 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gzdxb"] Jun 09 11:44:29.185564 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:44:29.185527 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69b2b4f5_5160_438e_a27a_898f05a45442.slice/crio-69838b04465f3cdb03affd319aa96a42381fea5406061ddb2f3601ce5b76c10b WatchSource:0}: Error finding container 69838b04465f3cdb03affd319aa96a42381fea5406061ddb2f3601ce5b76c10b: Status 404 returned error can't find the container with id 69838b04465f3cdb03affd319aa96a42381fea5406061ddb2f3601ce5b76c10b Jun 09 11:44:29.397168 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:29.397074 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzdxb" event={"ID":"69b2b4f5-5160-438e-a27a-898f05a45442","Type":"ContainerStarted","Data":"69838b04465f3cdb03affd319aa96a42381fea5406061ddb2f3601ce5b76c10b"} Jun 09 11:44:29.398421 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:29.398388 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4c5m9" event={"ID":"70594268-f6c1-47b6-b209-4dda25f8d6ab","Type":"ContainerStarted","Data":"fbc4e0b584b4eeb4e0717fba37a9fbca07032fc30e9e238c31d431aa13359091"} Jun 09 11:44:31.796982 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:31.796919 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:44:31.797533 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:31.797126 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:44:31.797533 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:44:31.797239 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:45:03.797217096 +0000 UTC m=+100.298072262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:44:34.414563 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:34.414523 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4c5m9" event={"ID":"70594268-f6c1-47b6-b209-4dda25f8d6ab","Type":"ContainerStarted","Data":"007516597ed17ef69d1609e6cd87b2faa245bbc083d4b5bcd43548783e30543d"} Jun 09 11:44:34.414955 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:34.414676 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:44:34.429919 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:34.429869 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4c5m9" podStartSLOduration=65.168322329 podStartE2EDuration="1m10.429852476s" totalImagesPullingTime="5.261530147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:44:34.429121293 +0000 UTC m=+70.929976483" watchObservedRunningTime="2026-06-09 11:44:34.429852476 +0000 UTC m=+70.930707663" Jun 09 11:44:35.418813 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:35.418769 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gzdxb" event={"ID":"69b2b4f5-5160-438e-a27a-898f05a45442","Type":"ContainerStarted","Data":"14260af5e2a471a1cf272152c788d29e0610b8c6ade2213d1e63d27d657f264a"} Jun 09 11:44:35.434835 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:44:35.434779 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gzdxb" podStartSLOduration=66.33414308 podStartE2EDuration="1m11.434742679s" totalImagesPullingTime="5.100599599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:44:35.434385773 +0000 UTC m=+71.935240974" watchObservedRunningTime="2026-06-09 11:44:35.434742679 +0000 UTC m=+71.935597871" Jun 09 11:45:03.836391 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:45:03.836337 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:45:03.836876 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:45:03.836493 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:45:03.836876 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:45:03.836559 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:46:07.836542629 +0000 UTC m=+164.337397795 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:45:05.421162 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:45:05.421129 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4c5m9" Jun 09 11:45:32.838942 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:45:32.838897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:45:32.839419 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:45:32.839025 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:45:32.839419 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:45:32.839087 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs podName:45100e9a-1edb-470f-80e8-610e52b80030 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:34.839069977 +0000 UTC m=+251.339925143 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs") pod "network-metrics-daemon-6qzc6" (UID: "45100e9a-1edb-470f-80e8-610e52b80030") : secret "metrics-daemon-secret" not found Jun 09 11:45:47.613895 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:45:47.613859 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:02.923289 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:02.923246 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6vhbc" podUID="77caa6f0-d5ca-42b3-9f4b-82b143a651fa" Jun 09 11:46:03.633049 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:03.633018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:46:03.956415 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:03.956323 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-6qzc6" podUID="45100e9a-1edb-470f-80e8-610e52b80030" Jun 09 11:46:07.874951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:07.874885 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:46:07.875363 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:07.875044 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:46:07.875363 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:07.875119 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls podName:77caa6f0-d5ca-42b3-9f4b-82b143a651fa nodeName:}" failed. No retries permitted until 2026-06-09 11:48:09.87509796 +0000 UTC m=+286.375953125 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls") pod "dns-default-6vhbc" (UID: "77caa6f0-d5ca-42b3-9f4b-82b143a651fa") : secret "dns-default-metrics-tls" not found Jun 09 11:46:17.943332 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:17.943246 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:46:39.365325 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:39.365294 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:46.360838 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.360800 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b"] Jun 09 11:46:46.363789 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.363591 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.366368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.366336 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 11:46:46.366521 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.366352 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:46:46.367045 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.367025 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:46:46.367122 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.367025 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-7klhs\"" Jun 09 11:46:46.368326 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.368311 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 11:46:46.377311 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.377278 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b"] Jun 09 11:46:46.383733 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.383705 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486"] Jun 09 11:46:46.386568 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.386547 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" Jun 09 11:46:46.389775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.389727 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ljw8q\"" Jun 09 11:46:46.389775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.389740 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:46:46.390023 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.390010 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 11:46:46.401267 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.401237 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486"] Jun 09 11:46:46.446288 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.446253 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb"] Jun 09 11:46:46.446485 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.446462 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slp7p\" (UniqueName: \"kubernetes.io/projected/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-kube-api-access-slp7p\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.446552 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.446529 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.446588 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.446579 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgp8c\" (UniqueName: \"kubernetes.io/projected/0325a29b-e44d-4c32-809a-ed5dda9aa254-kube-api-access-zgp8c\") pod \"volume-data-source-validator-78dd696465-xw486\" (UID: \"0325a29b-e44d-4c32-809a-ed5dda9aa254\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" Jun 09 11:46:46.446621 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.446609 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.449026 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.449011 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" Jun 09 11:46:46.451286 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.451264 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p2kvf\"" Jun 09 11:46:46.453845 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.453817 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5"] Jun 09 11:46:46.456589 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.456571 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7"] Jun 09 11:46:46.456707 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.456687 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.459301 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.459282 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rxqr"] Jun 09 11:46:46.459459 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.459437 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.459617 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.459595 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 11:46:46.459690 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.459603 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-45mtn\"" Jun 09 11:46:46.460152 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.460131 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 11:46:46.462138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462116 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 11:46:46.462237 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462146 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-lwtls\"" Jun 09 11:46:46.462396 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462377 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:46:46.462455 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462384 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb"] Jun 09 11:46:46.462455 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462449 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.462594 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.462567 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 11:46:46.463336 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.463316 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 11:46:46.464771 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.464733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 11:46:46.465812 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.465366 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 11:46:46.465812 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.465374 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:46:46.465812 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.465483 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k5cll\"" Jun 09 11:46:46.465812 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.465719 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 11:46:46.470790 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.470768 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7"] Jun 09 11:46:46.471654 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.471629 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5"] Jun 09 11:46:46.472074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.472055 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 11:46:46.472574 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.472557 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rxqr"] Jun 09 11:46:46.547523 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547486 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgp8c\" (UniqueName: \"kubernetes.io/projected/0325a29b-e44d-4c32-809a-ed5dda9aa254-kube-api-access-zgp8c\") pod \"volume-data-source-validator-78dd696465-xw486\" (UID: \"0325a29b-e44d-4c32-809a-ed5dda9aa254\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" Jun 09 11:46:46.547523 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547528 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547552 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-config\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547569 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547636 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slp7p\" (UniqueName: \"kubernetes.io/projected/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-kube-api-access-slp7p\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c0d2c7-8ec5-4b50-a168-07e24ea02234-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547740 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547792 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37a86ee5-3f59-419b-8786-9d74e68a7f47-serving-cert\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.547821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547816 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmkkz\" (UniqueName: \"kubernetes.io/projected/37a86ee5-3f59-419b-8786-9d74e68a7f47-kube-api-access-hmkkz\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547865 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.547923 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547963 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c0d2c7-8ec5-4b50-a168-07e24ea02234-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.547983 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zxn4\" (UniqueName: \"kubernetes.io/projected/18c0d2c7-8ec5-4b50-a168-07e24ea02234-kube-api-access-4zxn4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.548003 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:46:47.047983577 +0000 UTC m=+203.548838757 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.548053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-trusted-ca\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.548119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.548084 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrd47\" (UniqueName: \"kubernetes.io/projected/04000a5e-6faa-45c3-9333-a2862ce49e1e-kube-api-access-zrd47\") pod \"network-check-source-dbd9cf844-rl9fb\" (UID: \"04000a5e-6faa-45c3-9333-a2862ce49e1e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" Jun 09 11:46:46.548353 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.548342 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.551950 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.551927 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:46:46.554981 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.554966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.556477 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.556453 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:46.557487 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.557470 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:46:46.557780 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.557736 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-wgg7g\"" Jun 09 11:46:46.557940 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.557924 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:46:46.558178 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.558164 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:46:46.562216 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.562131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgp8c\" (UniqueName: \"kubernetes.io/projected/0325a29b-e44d-4c32-809a-ed5dda9aa254-kube-api-access-zgp8c\") pod \"volume-data-source-validator-78dd696465-xw486\" (UID: \"0325a29b-e44d-4c32-809a-ed5dda9aa254\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" Jun 09 11:46:46.562927 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.562900 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-slp7p\" (UniqueName: \"kubernetes.io/projected/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-kube-api-access-slp7p\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:46.565189 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.565171 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:46:46.569890 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.569865 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:46:46.635255 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.635138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:46.649244 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c0d2c7-8ec5-4b50-a168-07e24ea02234-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.649374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649257 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85mzc\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.649374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649281 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.649374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649297 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.649374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649332 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-trusted-ca\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.649374 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649354 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrd47\" (UniqueName: \"kubernetes.io/projected/04000a5e-6faa-45c3-9333-a2862ce49e1e-kube-api-access-zrd47\") pod \"network-check-source-dbd9cf844-rl9fb\" (UID: \"04000a5e-6faa-45c3-9333-a2862ce49e1e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" Jun 09 11:46:46.649895 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.650005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649929 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.650005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.649967 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.650147 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650002 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.650147 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650057 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.650262 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.650442 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650418 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmkkz\" (UniqueName: \"kubernetes.io/projected/37a86ee5-3f59-419b-8786-9d74e68a7f47-kube-api-access-hmkkz\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.650572 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650462 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37a86ee5-3f59-419b-8786-9d74e68a7f47-serving-cert\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.650632 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650602 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c0d2c7-8ec5-4b50-a168-07e24ea02234-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.650800 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650780 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zxn4\" (UniqueName: \"kubernetes.io/projected/18c0d2c7-8ec5-4b50-a168-07e24ea02234-kube-api-access-4zxn4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.650869 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650828 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.651075 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.651048 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:46.651142 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650887 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-config\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.651217 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.651144 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-trusted-ca\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.651270 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.650238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/18c0d2c7-8ec5-4b50-a168-07e24ea02234-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.651701 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.651672 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/37a86ee5-3f59-419b-8786-9d74e68a7f47-config\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.651832 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.651814 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:46:46.651902 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.651891 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:47.151871894 +0000 UTC m=+203.652727075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:46:46.654858 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.654828 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/18c0d2c7-8ec5-4b50-a168-07e24ea02234-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.655964 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.655943 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/37a86ee5-3f59-419b-8786-9d74e68a7f47-serving-cert\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.658862 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.658832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrd47\" (UniqueName: \"kubernetes.io/projected/04000a5e-6faa-45c3-9333-a2862ce49e1e-kube-api-access-zrd47\") pod \"network-check-source-dbd9cf844-rl9fb\" (UID: \"04000a5e-6faa-45c3-9333-a2862ce49e1e\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" Jun 09 11:46:46.659252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.659233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zxn4\" (UniqueName: \"kubernetes.io/projected/18c0d2c7-8ec5-4b50-a168-07e24ea02234-kube-api-access-4zxn4\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-wz7t7\" (UID: \"18c0d2c7-8ec5-4b50-a168-07e24ea02234\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.662436 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.662411 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmkkz\" (UniqueName: \"kubernetes.io/projected/37a86ee5-3f59-419b-8786-9d74e68a7f47-kube-api-access-hmkkz\") pod \"console-operator-668fdbf85c-8rxqr\" (UID: \"37a86ee5-3f59-419b-8786-9d74e68a7f47\") " pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.696035 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.695999 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" Jun 09 11:46:46.735478 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.735444 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:46.752464 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.752674 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.752674 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752507 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.752674 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.752856 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.752675 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:46:46.752856 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.752703 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c85fdc47-49ncv: secret "image-registry-tls" not found Jun 09 11:46:46.752856 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:46.752823 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls podName:88106101-3896-485f-abf1-80da6473eb5d nodeName:}" failed. No retries permitted until 2026-06-09 11:46:47.252796543 +0000 UTC m=+203.753651729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls") pod "image-registry-56c85fdc47-49ncv" (UID: "88106101-3896-485f-abf1-80da6473eb5d") : secret "image-registry-tls" not found Jun 09 11:46:46.753092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752688 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85mzc\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.753092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.752979 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.753092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.753009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.753092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.753051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.753513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.753482 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.753850 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.753808 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.754720 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.754687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.755349 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.755329 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.756276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.756245 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.759133 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.759086 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" Jun 09 11:46:46.762480 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.762422 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85mzc\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.762663 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.762594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:46.777279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.777244 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" Jun 09 11:46:46.783498 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.783463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:46.846287 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.846106 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486"] Jun 09 11:46:46.859033 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:46:46.858672 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0325a29b_e44d_4c32_809a_ed5dda9aa254.slice/crio-002b8e84f5999035f206456335955ed4f85b42a65fdaf18158bcc3b3d89ea9ef WatchSource:0}: Error finding container 002b8e84f5999035f206456335955ed4f85b42a65fdaf18158bcc3b3d89ea9ef: Status 404 returned error can't find the container with id 002b8e84f5999035f206456335955ed4f85b42a65fdaf18158bcc3b3d89ea9ef Jun 09 11:46:46.924192 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.924107 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb"] Jun 09 11:46:46.928070 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:46:46.928037 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04000a5e_6faa_45c3_9333_a2862ce49e1e.slice/crio-9f88a7d4eaa653066dd2e387cd85fdc3531ecaec67c751cdfb356886a8d12793 WatchSource:0}: Error finding container 9f88a7d4eaa653066dd2e387cd85fdc3531ecaec67c751cdfb356886a8d12793: Status 404 returned error can't find the container with id 9f88a7d4eaa653066dd2e387cd85fdc3531ecaec67c751cdfb356886a8d12793 Jun 09 11:46:46.940487 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.940451 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7"] Jun 09 11:46:46.944910 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:46:46.944876 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18c0d2c7_8ec5_4b50_a168_07e24ea02234.slice/crio-e2a83254ce1fd48a176309f9dc85188653fb232773c8a7497fe618711ccc37dd WatchSource:0}: Error finding container e2a83254ce1fd48a176309f9dc85188653fb232773c8a7497fe618711ccc37dd: Status 404 returned error can't find the container with id e2a83254ce1fd48a176309f9dc85188653fb232773c8a7497fe618711ccc37dd Jun 09 11:46:46.962682 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:46.962653 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-8rxqr"] Jun 09 11:46:46.966389 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:46:46.966359 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a86ee5_3f59_419b_8786_9d74e68a7f47.slice/crio-337ab8649eae14399eeafc8c2c769dc6b1e6dedb50e2ccb7fb074b6e4c6cdfdd WatchSource:0}: Error finding container 337ab8649eae14399eeafc8c2c769dc6b1e6dedb50e2ccb7fb074b6e4c6cdfdd: Status 404 returned error can't find the container with id 337ab8649eae14399eeafc8c2c769dc6b1e6dedb50e2ccb7fb074b6e4c6cdfdd Jun 09 11:46:47.057144 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.057098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:47.057346 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.057273 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:47.057410 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.057359 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:46:48.057335134 +0000 UTC m=+204.558190313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:47.157675 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.157569 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:47.157886 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.157737 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:46:47.157886 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.157839 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:48.157822422 +0000 UTC m=+204.658677588 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:46:47.258664 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.258613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:47.258873 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.258852 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:46:47.258935 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.258876 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c85fdc47-49ncv: secret "image-registry-tls" not found Jun 09 11:46:47.258984 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:47.258937 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls podName:88106101-3896-485f-abf1-80da6473eb5d nodeName:}" failed. No retries permitted until 2026-06-09 11:46:48.258919569 +0000 UTC m=+204.759774738 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls") pod "image-registry-56c85fdc47-49ncv" (UID: "88106101-3896-485f-abf1-80da6473eb5d") : secret "image-registry-tls" not found Jun 09 11:46:47.741567 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.741479 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" event={"ID":"37a86ee5-3f59-419b-8786-9d74e68a7f47","Type":"ContainerStarted","Data":"337ab8649eae14399eeafc8c2c769dc6b1e6dedb50e2ccb7fb074b6e4c6cdfdd"} Jun 09 11:46:47.743326 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.743265 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" event={"ID":"0325a29b-e44d-4c32-809a-ed5dda9aa254","Type":"ContainerStarted","Data":"002b8e84f5999035f206456335955ed4f85b42a65fdaf18158bcc3b3d89ea9ef"} Jun 09 11:46:47.744812 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.744778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" event={"ID":"18c0d2c7-8ec5-4b50-a168-07e24ea02234","Type":"ContainerStarted","Data":"e2a83254ce1fd48a176309f9dc85188653fb232773c8a7497fe618711ccc37dd"} Jun 09 11:46:47.747065 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.747035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" event={"ID":"04000a5e-6faa-45c3-9333-a2862ce49e1e","Type":"ContainerStarted","Data":"fa7207b24ab605d78110394b224ed56bf5191a9e3151a3e4806d27b0e28e409f"} Jun 09 11:46:47.747195 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:47.747089 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" event={"ID":"04000a5e-6faa-45c3-9333-a2862ce49e1e","Type":"ContainerStarted","Data":"9f88a7d4eaa653066dd2e387cd85fdc3531ecaec67c751cdfb356886a8d12793"} Jun 09 11:46:48.067261 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.067174 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:48.067442 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.067387 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:48.067513 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.067461 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:46:50.067438306 +0000 UTC m=+206.568293475 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:48.168519 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.168383 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:48.168519 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.168509 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:46:48.168771 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.168584 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:50.168564975 +0000 UTC m=+206.669420158 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:46:48.269842 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.269804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:48.270035 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.269982 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:46:48.270035 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.270004 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c85fdc47-49ncv: secret "image-registry-tls" not found Jun 09 11:46:48.270143 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:48.270084 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls podName:88106101-3896-485f-abf1-80da6473eb5d nodeName:}" failed. No retries permitted until 2026-06-09 11:46:50.270059076 +0000 UTC m=+206.770914259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls") pod "image-registry-56c85fdc47-49ncv" (UID: "88106101-3896-485f-abf1-80da6473eb5d") : secret "image-registry-tls" not found Jun 09 11:46:48.753682 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.753630 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" event={"ID":"0325a29b-e44d-4c32-809a-ed5dda9aa254","Type":"ContainerStarted","Data":"96713a08de42ca100214068b1b4c6753578b73673311691dfe5f35550c7d3b12"} Jun 09 11:46:48.768574 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.768510 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-xw486" podStartSLOduration=1.584600695 podStartE2EDuration="2.768489713s" totalImagesPullingTime="1.183889018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:48.768220281 +0000 UTC m=+205.269075472" watchObservedRunningTime="2026-06-09 11:46:48.768489713 +0000 UTC m=+205.269344902" Jun 09 11:46:48.768817 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.768605 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-rl9fb" podStartSLOduration=2.768595383 podStartE2EDuration="2.768595383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:47.763821893 +0000 UTC m=+204.264677082" watchObservedRunningTime="2026-06-09 11:46:48.768595383 +0000 UTC m=+205.269450574" Jun 09 11:46:48.865047 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.865005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:48.919822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:48.919718 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:49.758728 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.758683 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" event={"ID":"18c0d2c7-8ec5-4b50-a168-07e24ea02234","Type":"ContainerStarted","Data":"8e4534aed7e652e077d610ba3673789762eb60affa0fb5f79e6102d3055b5bca"} Jun 09 11:46:49.760371 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.760345 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/0.log" Jun 09 11:46:49.760522 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.760389 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a86ee5-3f59-419b-8786-9d74e68a7f47" containerID="c55bf54f2d8ece80237b8ece16b69f542668230231a6efb7e032adc8e43d78bb" exitCode=255 Jun 09 11:46:49.760522 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.760473 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" event={"ID":"37a86ee5-3f59-419b-8786-9d74e68a7f47","Type":"ContainerDied","Data":"c55bf54f2d8ece80237b8ece16b69f542668230231a6efb7e032adc8e43d78bb"} Jun 09 11:46:49.760639 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.760629 2562 scope.go:117] "RemoveContainer" containerID="c55bf54f2d8ece80237b8ece16b69f542668230231a6efb7e032adc8e43d78bb" Jun 09 11:46:49.774517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:49.774456 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" podStartSLOduration=1.267345543 podStartE2EDuration="3.774433335s" totalImagesPullingTime="2.507087792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:49.773342767 +0000 UTC m=+206.274197985" watchObservedRunningTime="2026-06-09 11:46:49.774433335 +0000 UTC m=+206.275288524" Jun 09 11:46:50.087780 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.087660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:50.087996 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.087823 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:50.087996 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.087892 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:46:54.087874695 +0000 UTC m=+210.588729861 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:50.188515 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.188475 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:50.188692 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.188599 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:46:50.188692 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.188656 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:54.188639841 +0000 UTC m=+210.689495006 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:46:50.289208 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.289167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:50.289376 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.289321 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:46:50.289376 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.289340 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c85fdc47-49ncv: secret "image-registry-tls" not found Jun 09 11:46:50.289443 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.289398 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls podName:88106101-3896-485f-abf1-80da6473eb5d nodeName:}" failed. No retries permitted until 2026-06-09 11:46:54.289380151 +0000 UTC m=+210.790235335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls") pod "image-registry-56c85fdc47-49ncv" (UID: "88106101-3896-485f-abf1-80da6473eb5d") : secret "image-registry-tls" not found Jun 09 11:46:50.608792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.608737 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:50.729524 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.729468 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:50.764911 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.764883 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:46:50.765352 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.765336 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/0.log" Jun 09 11:46:50.765408 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.765379 2562 generic.go:356] "Generic (PLEG): container finished" podID="37a86ee5-3f59-419b-8786-9d74e68a7f47" containerID="a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f" exitCode=255 Jun 09 11:46:50.765493 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.765470 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" event={"ID":"37a86ee5-3f59-419b-8786-9d74e68a7f47","Type":"ContainerDied","Data":"a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f"} Jun 09 11:46:50.765543 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.765526 2562 scope.go:117] "RemoveContainer" containerID="c55bf54f2d8ece80237b8ece16b69f542668230231a6efb7e032adc8e43d78bb" Jun 09 11:46:50.765816 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.765789 2562 scope.go:117] "RemoveContainer" containerID="a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f" Jun 09 11:46:50.765995 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:50.765975 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rxqr_openshift-console-operator(37a86ee5-3f59-419b-8786-9d74e68a7f47)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" podUID="37a86ee5-3f59-419b-8786-9d74e68a7f47" Jun 09 11:46:50.811160 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.811121 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:50.911530 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:50.911445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.171994 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.171906 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.270832 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.270797 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.371186 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.371150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.426006 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.425928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.640071 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.640037 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.703299 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.703218 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:51.770864 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.770834 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:46:51.771286 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:51.771196 2562 scope.go:117] "RemoveContainer" containerID="a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f" Jun 09 11:46:51.771381 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:51.771361 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rxqr_openshift-console-operator(37a86ee5-3f59-419b-8786-9d74e68a7f47)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" podUID="37a86ee5-3f59-419b-8786-9d74e68a7f47" Jun 09 11:46:52.954666 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.954631 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4jkw2"] Jun 09 11:46:52.958990 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.958968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:52.961338 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.961306 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 11:46:52.961338 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.961307 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 11:46:52.961536 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.961312 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-gk4wq\"" Jun 09 11:46:52.962422 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.962406 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 11:46:52.962422 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.962417 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 11:46:52.965427 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:52.965399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4jkw2"] Jun 09 11:46:53.014554 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.014521 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxxms\" (UniqueName: \"kubernetes.io/projected/0146d370-5c45-4d22-a9a5-bdc8799fec63-kube-api-access-cxxms\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.014761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.014562 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-cabundle\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.014761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.014608 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-key\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.056762 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.056726 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:53.115139 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.115106 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-key\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.115313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.115199 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxxms\" (UniqueName: \"kubernetes.io/projected/0146d370-5c45-4d22-a9a5-bdc8799fec63-kube-api-access-cxxms\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.115313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.115221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-cabundle\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.115862 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.115839 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-cabundle\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.117708 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.117680 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0146d370-5c45-4d22-a9a5-bdc8799fec63-signing-key\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.124161 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.124129 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxxms\" (UniqueName: \"kubernetes.io/projected/0146d370-5c45-4d22-a9a5-bdc8799fec63-kube-api-access-cxxms\") pod \"service-ca-7d74d578b8-4jkw2\" (UID: \"0146d370-5c45-4d22-a9a5-bdc8799fec63\") " pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.157966 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.157928 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:53.269482 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.269433 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" Jun 09 11:46:53.299327 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.299296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8xcd_6f71d7f7-9784-406e-84e6-432a0abafec5/dns-node-resolver/0.log" Jun 09 11:46:53.403738 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.403706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-4jkw2"] Jun 09 11:46:53.407088 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:46:53.407051 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0146d370_5c45_4d22_a9a5_bdc8799fec63.slice/crio-bbdf952e2831528172c0a9af899ad7ca9c0b275b0cef7efa66e06b6fd5b30474 WatchSource:0}: Error finding container bbdf952e2831528172c0a9af899ad7ca9c0b275b0cef7efa66e06b6fd5b30474: Status 404 returned error can't find the container with id bbdf952e2831528172c0a9af899ad7ca9c0b275b0cef7efa66e06b6fd5b30474 Jun 09 11:46:53.782082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.782043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" event={"ID":"0146d370-5c45-4d22-a9a5-bdc8799fec63","Type":"ContainerStarted","Data":"bbdf952e2831528172c0a9af899ad7ca9c0b275b0cef7efa66e06b6fd5b30474"} Jun 09 11:46:53.989920 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:53.989877 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:54.096280 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:54.096189 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dgcll_3b88fee1-9655-4476-8cd7-c7194a94de17/node-ca/0.log" Jun 09 11:46:54.122634 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:54.122592 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:46:54.122838 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.122769 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:54.122913 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.122849 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:47:02.12282876 +0000 UTC m=+218.623683929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:46:54.224164 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:54.224120 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:46:54.224343 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.224288 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:46:54.224388 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.224372 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:02.224352718 +0000 UTC m=+218.725207886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:46:54.324888 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:54.324838 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:46:54.325102 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.325012 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:46:54.325102 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.325036 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-56c85fdc47-49ncv: secret "image-registry-tls" not found Jun 09 11:46:54.325236 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:54.325111 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls podName:88106101-3896-485f-abf1-80da6473eb5d nodeName:}" failed. No retries permitted until 2026-06-09 11:47:02.325089671 +0000 UTC m=+218.825944848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls") pod "image-registry-56c85fdc47-49ncv" (UID: "88106101-3896-485f-abf1-80da6473eb5d") : secret "image-registry-tls" not found Jun 09 11:46:54.696961 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:54.696924 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48qdm_622abbef-221f-479b-bca1-cd2e3e2eff02/serve-healthcheck-canary/0.log" Jun 09 11:46:55.792046 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:55.792009 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" event={"ID":"0146d370-5c45-4d22-a9a5-bdc8799fec63","Type":"ContainerStarted","Data":"4b5b4d3fd4d4521369046479d0887b85490b309b89a8b021766fe67b25e064fc"} Jun 09 11:46:56.465395 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:56.465310 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:56.784645 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:56.784555 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:56.784645 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:56.784617 2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:46:56.784983 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:56.784969 2562 scope.go:117] "RemoveContainer" containerID="a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f" Jun 09 11:46:56.785141 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:46:56.785118 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-8rxqr_openshift-console-operator(37a86ee5-3f59-419b-8786-9d74e68a7f47)\"" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" podUID="37a86ee5-3f59-419b-8786-9d74e68a7f47" Jun 09 11:46:57.577627 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:57.577584 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:57.682684 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:57.682649 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:57.781987 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:57.781939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:57.879291 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:57.879199 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:57.984405 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:57.984307 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:58.678555 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:58.678521 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:59.081079 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:59.081035 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:59.278552 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:59.278515 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:59.873058 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:46:59.873024 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:00.475867 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:00.475833 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:00.672903 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:00.672863 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:00.873295 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:00.873203 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:01.275199 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:01.275163 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:01.470470 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:01.470432 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:01.570818 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:01.570690 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:02.116417 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.116385 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:02.190971 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.190937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:47:02.191149 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:02.191104 2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 11:47:02.191197 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:02.191184 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls podName:5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c nodeName:}" failed. No retries permitted until 2026-06-09 11:47:18.19116242 +0000 UTC m=+234.692017586 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-9gk5b" (UID: "5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c") : secret "cluster-monitoring-operator-tls" not found Jun 09 11:47:02.291782 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.291725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:47:02.291978 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:02.291859 2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:47:02.291978 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:02.291923 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert podName:c0ccf38e-6aa8-484f-8829-d5b2e5be0df7 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:18.291906149 +0000 UTC m=+234.792761319 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-msnv5" (UID: "c0ccf38e-6aa8-484f-8829-d5b2e5be0df7") : secret "networking-console-plugin-cert" not found Jun 09 11:47:02.392476 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.392375 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:02.395054 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.395033 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"image-registry-56c85fdc47-49ncv\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:02.470467 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.470424 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:02.481176 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.481150 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:02.608241 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.608184 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-4jkw2" podStartSLOduration=8.669210459 podStartE2EDuration="10.608159899s" totalImagesPullingTime="1.93894944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:55.822437653 +0000 UTC m=+212.323292840" watchObservedRunningTime="2026-06-09 11:47:02.608159899 +0000 UTC m=+219.109015088" Jun 09 11:47:02.608453 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.608431 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:47:02.611056 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:02.611029 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88106101_3896_485f_abf1_80da6473eb5d.slice/crio-f91e3f534aa9280a809a5ce1d5d0f04e0ef0d7413b60b7f535f81a6c162367f8 WatchSource:0}: Error finding container f91e3f534aa9280a809a5ce1d5d0f04e0ef0d7413b60b7f535f81a6c162367f8: Status 404 returned error can't find the container with id f91e3f534aa9280a809a5ce1d5d0f04e0ef0d7413b60b7f535f81a6c162367f8 Jun 09 11:47:02.815710 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.815671 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" event={"ID":"88106101-3896-485f-abf1-80da6473eb5d","Type":"ContainerStarted","Data":"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb"} Jun 09 11:47:02.815923 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.815725 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" event={"ID":"88106101-3896-485f-abf1-80da6473eb5d","Type":"ContainerStarted","Data":"f91e3f534aa9280a809a5ce1d5d0f04e0ef0d7413b60b7f535f81a6c162367f8"} Jun 09 11:47:02.815923 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.815805 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:02.833870 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.833798 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" podStartSLOduration=16.833779424 podStartE2EDuration="16.833779424s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:02.833267845 +0000 UTC m=+219.334123035" watchObservedRunningTime="2026-06-09 11:47:02.833779424 +0000 UTC m=+219.334634609" Jun 09 11:47:02.875138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:02.875093 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:03.072832 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:03.072801 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:03.271078 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:03.271042 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:03.471119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:03.471086 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:03.643082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:03.643043 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:04.305069 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:04.305031 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:04.476230 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:04.476200 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:04.671092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:04.671005 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:05.074970 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:05.074930 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:05.277082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:05.277046 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:05.874325 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:05.874287 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:05.931718 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:05.931682 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:06.279980 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:06.279944 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:06.672200 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:06.672110 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:07.078029 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:07.077992 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:07.472586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:07.472537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:07.872649 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:07.872541 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:07.943724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:07.943693 2562 scope.go:117] "RemoveContainer" containerID="a4de540b409423786545b163c14c1a4e34af8db4f9d81c981d12323407edd54f" Jun 09 11:47:08.075823 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.075791 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:08.272978 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.272939 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:08.836241 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.836211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:47:08.836419 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.836304 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" event={"ID":"37a86ee5-3f59-419b-8786-9d74e68a7f47","Type":"ContainerStarted","Data":"f7427a7821fbe66b5781498139193361ffc640de475db25e3fab1fe563f70d3a"} Jun 09 11:47:08.836593 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.836573 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:47:08.852863 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.852806 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" podStartSLOduration=20.36424938 podStartE2EDuration="22.852787973s" totalImagesPullingTime="2.488538593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:08.852136809 +0000 UTC m=+225.352991999" watchObservedRunningTime="2026-06-09 11:47:08.852787973 +0000 UTC m=+225.353643161" Jun 09 11:47:08.958274 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:08.958242 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-8rxqr" Jun 09 11:47:09.150228 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:09.150138 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:09.246920 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:09.246883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:09.311881 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:09.311840 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:09.436098 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:09.436004 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:09.815929 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:09.815883 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:10.227012 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:10.226968 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:10.291057 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:10.291000 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:10.447956 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:10.447895 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:10.506119 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:10.506034 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:10.832120 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:10.832038 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:11.029610 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:11.029577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:11.491101 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:11.491061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:12.041517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:12.041483 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:13.899457 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:13.899421 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:13.958988 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:13.958958 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:14.416918 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.416880 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:47:14.427650 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.427612 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmpp"] Jun 09 11:47:14.430658 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.430629 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.433427 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.433401 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:47:14.433427 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.433436 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:47:14.433662 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.433465 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:47:14.433662 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.433467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:47:14.433662 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.433401 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2bnbt\"" Jun 09 11:47:14.444077 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.444041 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmpp"] Jun 09 11:47:14.522321 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.522285 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:14.589799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.589737 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/592beceb-8920-4fa8-8aa3-c79e1fe7e358-data-volume\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.589972 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.589872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/592beceb-8920-4fa8-8aa3-c79e1fe7e358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.589972 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.589907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.589972 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.589934 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4p562\" (UniqueName: \"kubernetes.io/projected/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-api-access-4p562\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.590082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.589985 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/592beceb-8920-4fa8-8aa3-c79e1fe7e358-crio-socket\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.613566 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.613528 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:14.690386 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690386 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690336 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4p562\" (UniqueName: \"kubernetes.io/projected/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-api-access-4p562\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690386 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690389 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/592beceb-8920-4fa8-8aa3-c79e1fe7e358-crio-socket\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690632 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690420 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/592beceb-8920-4fa8-8aa3-c79e1fe7e358-data-volume\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690632 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690493 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/592beceb-8920-4fa8-8aa3-c79e1fe7e358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690632 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690529 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/592beceb-8920-4fa8-8aa3-c79e1fe7e358-crio-socket\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690842 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690820 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/592beceb-8920-4fa8-8aa3-c79e1fe7e358-data-volume\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.690982 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.690966 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.692998 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.692971 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/592beceb-8920-4fa8-8aa3-c79e1fe7e358-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.700084 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.700053 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4p562\" (UniqueName: \"kubernetes.io/projected/592beceb-8920-4fa8-8aa3-c79e1fe7e358-kube-api-access-4p562\") pod \"insights-runtime-extractor-bxmpp\" (UID: \"592beceb-8920-4fa8-8aa3-c79e1fe7e358\") " pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.742160 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.742123 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-bxmpp" Jun 09 11:47:14.883227 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:14.883191 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-bxmpp"] Jun 09 11:47:14.886560 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:14.886530 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod592beceb_8920_4fa8_8aa3_c79e1fe7e358.slice/crio-0a81c5d671325c6e5684cac263a3288f76d56f26db2d31f8e9a595a091134242 WatchSource:0}: Error finding container 0a81c5d671325c6e5684cac263a3288f76d56f26db2d31f8e9a595a091134242: Status 404 returned error can't find the container with id 0a81c5d671325c6e5684cac263a3288f76d56f26db2d31f8e9a595a091134242 Jun 09 11:47:15.859693 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:15.859602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmpp" event={"ID":"592beceb-8920-4fa8-8aa3-c79e1fe7e358","Type":"ContainerStarted","Data":"b5e1cdaf8ebef1181dec60a65ba3237bc76ea3de45cebd1e25e1215140669782"} Jun 09 11:47:15.859693 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:15.859664 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmpp" event={"ID":"592beceb-8920-4fa8-8aa3-c79e1fe7e358","Type":"ContainerStarted","Data":"09c22b9723af98de4fccb51231dec90b42378834cda5165e8a47b78f8cccf9e3"} Jun 09 11:47:15.859693 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:15.859685 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmpp" event={"ID":"592beceb-8920-4fa8-8aa3-c79e1fe7e358","Type":"ContainerStarted","Data":"0a81c5d671325c6e5684cac263a3288f76d56f26db2d31f8e9a595a091134242"} Jun 09 11:47:17.868498 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:17.868463 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-bxmpp" event={"ID":"592beceb-8920-4fa8-8aa3-c79e1fe7e358","Type":"ContainerStarted","Data":"779cff50ef55c698073cb67b0fbae0272132d02f87bc3692455b74fcdf7744ff"} Jun 09 11:47:17.890696 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:17.888553 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-bxmpp" podStartSLOduration=1.201851169 podStartE2EDuration="3.888529307s" totalImagesPullingTime="2.686678138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:47:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:17.88709097 +0000 UTC m=+234.387946155" watchObservedRunningTime="2026-06-09 11:47:17.888529307 +0000 UTC m=+234.389384498" Jun 09 11:47:18.223188 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.223145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:47:18.225815 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.225792 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-9gk5b\" (UID: \"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:47:18.324362 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.324322 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:47:18.326870 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.326848 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c0ccf38e-6aa8-484f-8829-d5b2e5be0df7-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-msnv5\" (UID: \"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:47:18.473683 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.473595 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" Jun 09 11:47:18.569021 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.568986 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" Jun 09 11:47:18.609666 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.609633 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b"] Jun 09 11:47:18.613344 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:18.613312 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f0bb332_9a3e_4fa0_a019_59fcbfd0dc3c.slice/crio-6c379cbdbcf946ae5e2d21c8ceb9048124790667c6bb8dfecc2f6cb68e704ee1 WatchSource:0}: Error finding container 6c379cbdbcf946ae5e2d21c8ceb9048124790667c6bb8dfecc2f6cb68e704ee1: Status 404 returned error can't find the container with id 6c379cbdbcf946ae5e2d21c8ceb9048124790667c6bb8dfecc2f6cb68e704ee1 Jun 09 11:47:18.708847 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.708805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5"] Jun 09 11:47:18.713655 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:18.713627 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ccf38e_6aa8_484f_8829_d5b2e5be0df7.slice/crio-5b39dffd6b414fd2d2b221806cde06ac586f02fe8f6a3868655793d48a35e95d WatchSource:0}: Error finding container 5b39dffd6b414fd2d2b221806cde06ac586f02fe8f6a3868655793d48a35e95d: Status 404 returned error can't find the container with id 5b39dffd6b414fd2d2b221806cde06ac586f02fe8f6a3868655793d48a35e95d Jun 09 11:47:18.873092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.872995 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" event={"ID":"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7","Type":"ContainerStarted","Data":"5b39dffd6b414fd2d2b221806cde06ac586f02fe8f6a3868655793d48a35e95d"} Jun 09 11:47:18.874070 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:18.874047 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" event={"ID":"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c","Type":"ContainerStarted","Data":"6c379cbdbcf946ae5e2d21c8ceb9048124790667c6bb8dfecc2f6cb68e704ee1"} Jun 09 11:47:19.790585 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:19.790545 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:19.848360 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:19.848317 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:20.659189 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.659149 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:47:20.662915 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.662890 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.665230 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665206 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 11:47:20.665230 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665223 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 11:47:20.665963 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665937 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 11:47:20.666104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 11:47:20.666104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665994 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 11:47:20.666104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665940 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 11:47:20.666104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.666078 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 11:47:20.666104 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.665937 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7zct7\"" Jun 09 11:47:20.672635 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.672608 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:47:20.744761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744651 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.744761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744696 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.744949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744790 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.744949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.744949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744871 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42ffm\" (UniqueName: \"kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.744949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.744895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.813761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.813721 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:20.845689 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.845649 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.845923 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.845697 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42ffm\" (UniqueName: \"kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.845923 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.845727 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.845923 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.845880 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.846111 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.845923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.846166 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.846145 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.846562 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.846526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.846871 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.846526 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.847033 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.847008 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.848683 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.848652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.848797 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.848684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.854554 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.854528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-42ffm\" (UniqueName: \"kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm\") pod \"console-745ffccbd8-src4n\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:20.882157 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.882117 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" event={"ID":"c0ccf38e-6aa8-484f-8829-d5b2e5be0df7","Type":"ContainerStarted","Data":"90b02278135a650ee0ad3d2ef1ff12be7af1ab0f8d8166411994c0a853333cd5"} Jun 09 11:47:20.883517 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.883491 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" event={"ID":"5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c","Type":"ContainerStarted","Data":"32d724e481a5eace7acfc8cb8732a9facae18d42da4796204f92671b02da205e"} Jun 09 11:47:20.896708 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.896613 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-msnv5" podStartSLOduration=33.726542245 podStartE2EDuration="34.896595516s" totalImagesPullingTime="1.170053271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:20.895793678 +0000 UTC m=+237.396648866" watchObservedRunningTime="2026-06-09 11:47:20.896595516 +0000 UTC m=+237.397450705" Jun 09 11:47:20.900663 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.900638 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:20.911313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.911246 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-9gk5b" podStartSLOduration=33.040619728 podStartE2EDuration="34.911227357s" totalImagesPullingTime="1.870607629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:46:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:20.910998423 +0000 UTC m=+237.411853612" watchObservedRunningTime="2026-06-09 11:47:20.911227357 +0000 UTC m=+237.412082546" Jun 09 11:47:20.973798 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:20.973739 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:21.051740 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.051703 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:21.057266 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.057232 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8"] Jun 09 11:47:21.060653 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.060627 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:21.063317 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.063217 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 11:47:21.063317 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.063254 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ds42v\"" Jun 09 11:47:21.074400 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.073586 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8"] Jun 09 11:47:21.123386 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.123346 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:47:21.126489 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.126445 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:21.127816 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:21.127790 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fff8e3f_135b_4fed_9de9_0ec5974fd189.slice/crio-196ec20333817a3c173552647404736ce88dd0479d876b133beef1fbf224746c WatchSource:0}: Error finding container 196ec20333817a3c173552647404736ce88dd0479d876b133beef1fbf224746c: Status 404 returned error can't find the container with id 196ec20333817a3c173552647404736ce88dd0479d876b133beef1fbf224746c Jun 09 11:47:21.149246 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.149210 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0374e593-87e5-4443-88eb-6a73db1a6878-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j7wh8\" (UID: \"0374e593-87e5-4443-88eb-6a73db1a6878\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:21.186465 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.186431 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:21.250193 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.250150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0374e593-87e5-4443-88eb-6a73db1a6878-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j7wh8\" (UID: \"0374e593-87e5-4443-88eb-6a73db1a6878\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:21.253058 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.253031 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/0374e593-87e5-4443-88eb-6a73db1a6878-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-j7wh8\" (UID: \"0374e593-87e5-4443-88eb-6a73db1a6878\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:21.377035 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.376931 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:21.448122 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.448089 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:21.514057 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.514019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8"] Jun 09 11:47:21.516978 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:21.516946 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0374e593_87e5_4443_88eb_6a73db1a6878.slice/crio-cdd472fa87591515dc6a0b16e2613d8233dd96edf33178ec0085c1597a76f1d2 WatchSource:0}: Error finding container cdd472fa87591515dc6a0b16e2613d8233dd96edf33178ec0085c1597a76f1d2: Status 404 returned error can't find the container with id cdd472fa87591515dc6a0b16e2613d8233dd96edf33178ec0085c1597a76f1d2 Jun 09 11:47:21.517935 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.517731 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:21.888450 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.888405 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745ffccbd8-src4n" event={"ID":"2fff8e3f-135b-4fed-9de9-0ec5974fd189","Type":"ContainerStarted","Data":"196ec20333817a3c173552647404736ce88dd0479d876b133beef1fbf224746c"} Jun 09 11:47:21.889721 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:21.889695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" event={"ID":"0374e593-87e5-4443-88eb-6a73db1a6878","Type":"ContainerStarted","Data":"cdd472fa87591515dc6a0b16e2613d8233dd96edf33178ec0085c1597a76f1d2"} Jun 09 11:47:23.459253 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.459154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:23.513568 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.513523 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:23.899987 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.899945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" event={"ID":"0374e593-87e5-4443-88eb-6a73db1a6878","Type":"ContainerStarted","Data":"8ea5c9b8fb4b12e2bd8c4aff46e5f717b0af273fc763280e4047c4c82fd68bd4"} Jun 09 11:47:23.900280 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.900170 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:23.905979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.905951 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" Jun 09 11:47:23.915402 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:23.915353 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-j7wh8" podStartSLOduration=1.30288492 podStartE2EDuration="2.915332451s" totalImagesPullingTime="1.612447531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:23.914545903 +0000 UTC m=+240.415401092" watchObservedRunningTime="2026-06-09 11:47:23.915332451 +0000 UTC m=+240.416187641" Jun 09 11:47:24.058022 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.057975 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:24.101223 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.101170 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc"] Jun 09 11:47:24.106495 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.106463 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.108894 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.108867 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-prvjf\"" Jun 09 11:47:24.109042 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.108928 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 11:47:24.109042 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.108991 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:47:24.109042 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.108879 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 11:47:24.115888 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.115608 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc"] Jun 09 11:47:24.130625 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.130583 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:24.178106 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.178016 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.178279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.178132 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hlr2\" (UniqueName: \"kubernetes.io/projected/111ca4f5-cc34-4722-8b23-bd955f820406-kube-api-access-2hlr2\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.178279 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.178202 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.178398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.178270 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/111ca4f5-cc34-4722-8b23-bd955f820406-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.279401 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.279358 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.279613 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.279421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/111ca4f5-cc34-4722-8b23-bd955f820406-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.279613 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.279511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.279613 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.279566 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hlr2\" (UniqueName: \"kubernetes.io/projected/111ca4f5-cc34-4722-8b23-bd955f820406-kube-api-access-2hlr2\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.280016 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:24.279959 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 11:47:24.280112 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:24.280046 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls podName:111ca4f5-cc34-4722-8b23-bd955f820406 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:24.780024071 +0000 UTC m=+241.280879240 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-nd4gc" (UID: "111ca4f5-cc34-4722-8b23-bd955f820406") : secret "prometheus-operator-tls" not found Jun 09 11:47:24.280491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.280461 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/111ca4f5-cc34-4722-8b23-bd955f820406-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.282678 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.282651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.289021 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.288990 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hlr2\" (UniqueName: \"kubernetes.io/projected/111ca4f5-cc34-4722-8b23-bd955f820406-kube-api-access-2hlr2\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.422575 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.422539 2562 patch_prober.go:28] interesting pod/image-registry-56c85fdc47-49ncv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:47:24.422736 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.422593 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:47:24.783270 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.783231 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:24.783778 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:24.783402 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 11:47:24.783778 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:24.783490 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls podName:111ca4f5-cc34-4722-8b23-bd955f820406 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:25.78346681 +0000 UTC m=+242.284321976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-nd4gc" (UID: "111ca4f5-cc34-4722-8b23-bd955f820406") : secret "prometheus-operator-tls" not found Jun 09 11:47:24.832624 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.832592 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:24.904634 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.904602 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745ffccbd8-src4n" event={"ID":"2fff8e3f-135b-4fed-9de9-0ec5974fd189","Type":"ContainerStarted","Data":"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1"} Jun 09 11:47:24.921588 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:24.921525 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-745ffccbd8-src4n" podStartSLOduration=1.5955918260000002 podStartE2EDuration="4.921505292s" totalImagesPullingTime="3.325913466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:24.921233953 +0000 UTC m=+241.422089140" watchObservedRunningTime="2026-06-09 11:47:24.921505292 +0000 UTC m=+241.422360480" Jun 09 11:47:25.792967 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:25.792927 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:25.795591 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:25.795567 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/111ca4f5-cc34-4722-8b23-bd955f820406-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nd4gc\" (UID: \"111ca4f5-cc34-4722-8b23-bd955f820406\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:25.919185 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:25.919144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" Jun 09 11:47:26.056420 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:26.056346 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc"] Jun 09 11:47:26.060198 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:26.060168 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod111ca4f5_cc34_4722_8b23_bd955f820406.slice/crio-f2c9f7dd908395ca3e6882e7ef5c853a3c3ff50b63faf1c6a7f4a2ab1e8310d3 WatchSource:0}: Error finding container f2c9f7dd908395ca3e6882e7ef5c853a3c3ff50b63faf1c6a7f4a2ab1e8310d3: Status 404 returned error can't find the container with id f2c9f7dd908395ca3e6882e7ef5c853a3c3ff50b63faf1c6a7f4a2ab1e8310d3 Jun 09 11:47:26.913060 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:26.913023 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" event={"ID":"111ca4f5-cc34-4722-8b23-bd955f820406","Type":"ContainerStarted","Data":"f2c9f7dd908395ca3e6882e7ef5c853a3c3ff50b63faf1c6a7f4a2ab1e8310d3"} Jun 09 11:47:27.654239 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.654151 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:47:27.656953 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.656933 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.661290 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.661257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:27.663817 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.663792 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 11:47:27.668190 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.668162 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:47:27.708780 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708716 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wszr2\" (UniqueName: \"kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.708962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.708962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708833 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.708962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708850 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.708962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708872 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.708962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708908 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.709120 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.708964 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809390 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809350 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809390 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809636 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809414 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809636 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809439 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809636 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809479 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809636 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809511 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.809879 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.809635 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wszr2\" (UniqueName: \"kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.810269 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.810232 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.810410 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.810275 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.810410 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.810382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.810502 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.810463 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.812138 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.812116 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.812221 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.812204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.818107 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.818078 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wszr2\" (UniqueName: \"kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2\") pod \"console-7d98766c56-wl5rw\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:27.918550 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.918464 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" event={"ID":"111ca4f5-cc34-4722-8b23-bd955f820406","Type":"ContainerStarted","Data":"08db2a675faa153ae0e5973475d0d45f3ab34c0aed39b76b9cd63e8f72753722"} Jun 09 11:47:27.918550 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.918519 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" event={"ID":"111ca4f5-cc34-4722-8b23-bd955f820406","Type":"ContainerStarted","Data":"897c640e8ae7c5425627a3329cfcb5dd2dfba9e884db40775ec0a35186ea09be"} Jun 09 11:47:27.936933 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.936884 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nd4gc" podStartSLOduration=2.642744751 podStartE2EDuration="3.936865672s" totalImagesPullingTime="1.294120921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:27.936059653 +0000 UTC m=+244.436914842" watchObservedRunningTime="2026-06-09 11:47:27.936865672 +0000 UTC m=+244.437720859" Jun 09 11:47:27.967508 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:27.967469 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:28.053305 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:28.053251 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:28.119667 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:28.119626 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:47:28.122377 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:28.122353 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401dd085_32c5_432f_9afe_bef6302cb450.slice/crio-5690b207e1e17cbf162d870d978d66af230be4a8bf238f5713afaf7f25ce5aac WatchSource:0}: Error finding container 5690b207e1e17cbf162d870d978d66af230be4a8bf238f5713afaf7f25ce5aac: Status 404 returned error can't find the container with id 5690b207e1e17cbf162d870d978d66af230be4a8bf238f5713afaf7f25ce5aac Jun 09 11:47:28.925227 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:28.923668 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d98766c56-wl5rw" event={"ID":"401dd085-32c5-432f-9afe-bef6302cb450","Type":"ContainerStarted","Data":"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698"} Jun 09 11:47:28.925227 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:28.924008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d98766c56-wl5rw" event={"ID":"401dd085-32c5-432f-9afe-bef6302cb450","Type":"ContainerStarted","Data":"5690b207e1e17cbf162d870d978d66af230be4a8bf238f5713afaf7f25ce5aac"} Jun 09 11:47:28.945193 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:28.945128 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d98766c56-wl5rw" podStartSLOduration=1.9451003359999999 podStartE2EDuration="1.945100336s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:28.944105302 +0000 UTC m=+245.444960487" watchObservedRunningTime="2026-06-09 11:47:28.945100336 +0000 UTC m=+245.445955522" Jun 09 11:47:29.214516 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.214482 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.335577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.335537 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.439924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.439885 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.494126 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.494042 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jv4wx"] Jun 09 11:47:29.509567 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.509532 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.512234 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.512163 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:47:29.512234 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.512165 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:47:29.512451 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.512284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tvz2p\"" Jun 09 11:47:29.512451 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.512194 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:47:29.532470 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.532436 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.600391 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.600356 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.624606 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624566 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-sys\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624606 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624605 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-root\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624635 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-accelerators-collector-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624656 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-metrics-client-ca\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624690 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-textfile\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624807 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-wtmp\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk4pj\" (UniqueName: \"kubernetes.io/projected/6323204d-1056-4e80-8fa8-c0942ba4bf71-kube-api-access-qk4pj\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.624899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.624879 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-tls\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.695303 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.695255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.725546 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725508 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-accelerators-collector-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.725739 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725556 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-metrics-client-ca\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.725739 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725710 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.725865 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-textfile\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.725865 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-wtmp\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.725865 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725851 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk4pj\" (UniqueName: \"kubernetes.io/projected/6323204d-1056-4e80-8fa8-c0942ba4bf71-kube-api-access-qk4pj\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726002 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-tls\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726002 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.725978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-sys\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726102 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-wtmp\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726102 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726009 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-root\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726102 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726062 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-root\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726242 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6323204d-1056-4e80-8fa8-c0942ba4bf71-sys\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726242 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726191 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-metrics-client-ca\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726570 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726547 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-accelerators-collector-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.726709 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.726632 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-textfile\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.728320 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.728303 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.728650 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.728634 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6323204d-1056-4e80-8fa8-c0942ba4bf71-node-exporter-tls\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.733706 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.733684 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk4pj\" (UniqueName: \"kubernetes.io/projected/6323204d-1056-4e80-8fa8-c0942ba4bf71-kube-api-access-qk4pj\") pod \"node-exporter-jv4wx\" (UID: \"6323204d-1056-4e80-8fa8-c0942ba4bf71\") " pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.796838 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.796730 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.820533 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.820490 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jv4wx" Jun 09 11:47:29.833373 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:29.833338 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6323204d_1056_4e80_8fa8_c0942ba4bf71.slice/crio-0b59e7ed4d88c2c2ab392c7c64c42528108e4e22d065e552dbaeb579bd5a1bdb WatchSource:0}: Error finding container 0b59e7ed4d88c2c2ab392c7c64c42528108e4e22d065e552dbaeb579bd5a1bdb: Status 404 returned error can't find the container with id 0b59e7ed4d88c2c2ab392c7c64c42528108e4e22d065e552dbaeb579bd5a1bdb Jun 09 11:47:29.895761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.895709 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:29.929513 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:29.929481 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jv4wx" event={"ID":"6323204d-1056-4e80-8fa8-c0942ba4bf71","Type":"ContainerStarted","Data":"0b59e7ed4d88c2c2ab392c7c64c42528108e4e22d065e552dbaeb579bd5a1bdb"} Jun 09 11:47:30.173346 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.173257 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:30.435702 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.435553 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:30.525270 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.525231 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:30.529668 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.529635 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:47:30.532327 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.532302 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.535405 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.534848 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 11:47:30.535405 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.535114 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tvfhz\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.535810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.536076 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.536292 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.536528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.539018 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.539221 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.539232 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 11:47:30.539908 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.539356 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 11:47:30.553145 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.553117 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:47:30.634260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634068 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvnq9\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-kube-api-access-wvnq9\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634152 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634195 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634238 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634310 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634373 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-volume\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634442 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634472 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-out\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634496 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634528 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-web-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634548 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634931 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634653 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.634931 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.634695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.640004 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.639971 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:30.736105 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736070 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-volume\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736304 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736304 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-out\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736304 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736228 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736304 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736261 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-web-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736304 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736291 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736324 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736384 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvnq9\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-kube-api-access-wvnq9\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736427 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736468 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736788 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736788 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.736926 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.736904 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.738424 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.737103 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.738424 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:30.737973 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle podName:f43616f7-ef35-4713-b12d-23c6ad5ae668 nodeName:}" failed. No retries permitted until 2026-06-09 11:47:31.237951366 +0000 UTC m=+247.738806556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "f43616f7-ef35-4713-b12d-23c6ad5ae668") : configmap references non-existent config key: ca-bundle.crt Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.740150 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-volume\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.740552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.740934 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-tls-assets\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.741064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.741375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.741924 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.741468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.742608 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.742583 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-web-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.743020 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.742999 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f43616f7-ef35-4713-b12d-23c6ad5ae668-config-out\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.744274 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.744222 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/f43616f7-ef35-4713-b12d-23c6ad5ae668-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.747053 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.747032 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvnq9\" (UniqueName: \"kubernetes.io/projected/f43616f7-ef35-4713-b12d-23c6ad5ae668-kube-api-access-wvnq9\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:30.936215 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.936177 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jv4wx" event={"ID":"6323204d-1056-4e80-8fa8-c0942ba4bf71","Type":"ContainerStarted","Data":"c63255a6029afa44c49b87681d718da6c335361799c6494a4ae1004cb979e085"} Jun 09 11:47:30.973919 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.973865 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:30.974081 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.973959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:47:30.975448 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.975419 2562 patch_prober.go:28] interesting pod/console-745ffccbd8-src4n container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jun 09 11:47:30.975554 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:30.975469 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-745ffccbd8-src4n" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jun 09 11:47:31.241720 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.241686 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:31.242777 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.242732 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f43616f7-ef35-4713-b12d-23c6ad5ae668-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"f43616f7-ef35-4713-b12d-23c6ad5ae668\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:31.447906 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.447874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:47:31.496604 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.496520 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:31.632529 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.632499 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:47:31.633717 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:31.633693 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf43616f7_ef35_4713_b12d_23c6ad5ae668.slice/crio-1bbbb7acf606ba78322acbb2dff84c80db8978231c7532933a2cf67fa4fbae9d WatchSource:0}: Error finding container 1bbbb7acf606ba78322acbb2dff84c80db8978231c7532933a2cf67fa4fbae9d: Status 404 returned error can't find the container with id 1bbbb7acf606ba78322acbb2dff84c80db8978231c7532933a2cf67fa4fbae9d Jun 09 11:47:31.941523 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.941419 2562 generic.go:356] "Generic (PLEG): container finished" podID="6323204d-1056-4e80-8fa8-c0942ba4bf71" containerID="c63255a6029afa44c49b87681d718da6c335361799c6494a4ae1004cb979e085" exitCode=0 Jun 09 11:47:31.942008 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.941509 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jv4wx" event={"ID":"6323204d-1056-4e80-8fa8-c0942ba4bf71","Type":"ContainerDied","Data":"c63255a6029afa44c49b87681d718da6c335361799c6494a4ae1004cb979e085"} Jun 09 11:47:31.942722 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:31.942700 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"1bbbb7acf606ba78322acbb2dff84c80db8978231c7532933a2cf67fa4fbae9d"} Jun 09 11:47:32.399603 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.399362 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:32.466238 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.466188 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:32.548935 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.548884 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:32.648013 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.647985 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:32.949334 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.949231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jv4wx" event={"ID":"6323204d-1056-4e80-8fa8-c0942ba4bf71","Type":"ContainerStarted","Data":"58c768771fe2412888ac0b854d5fab6274dbfee177e6fa1e9803de7cb8ac4d59"} Jun 09 11:47:32.949334 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.949299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jv4wx" event={"ID":"6323204d-1056-4e80-8fa8-c0942ba4bf71","Type":"ContainerStarted","Data":"3a2c47ee389a76dc6ec192137e63797a5e009d38d5101405c591964ead1510e0"} Jun 09 11:47:32.950852 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.950819 2562 generic.go:356] "Generic (PLEG): container finished" podID="f43616f7-ef35-4713-b12d-23c6ad5ae668" containerID="a0ce2fe211d5b90897b43eeeb6f286bd869171e37c7ecae58733d4e2685234cd" exitCode=0 Jun 09 11:47:32.950959 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.950861 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerDied","Data":"a0ce2fe211d5b90897b43eeeb6f286bd869171e37c7ecae58733d4e2685234cd"} Jun 09 11:47:32.969242 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:32.969189 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jv4wx" podStartSLOduration=2.937435902 podStartE2EDuration="3.969172642s" totalImagesPullingTime="955.848645ms" totalInitContainerRuntime="75.888095ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:47:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:32.968104877 +0000 UTC m=+249.468960065" watchObservedRunningTime="2026-06-09 11:47:32.969172642 +0000 UTC m=+249.470027831" Jun 09 11:47:33.772721 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.772683 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-65d7c64d77-lz24s"] Jun 09 11:47:33.775551 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.775524 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.777976 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.777949 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-v6xfl\"" Jun 09 11:47:33.778123 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.778058 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 11:47:33.779037 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.779008 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:47:33.779037 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.779019 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 11:47:33.779174 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.779014 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 11:47:33.779174 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.779099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1csijeueahr61\"" Jun 09 11:47:33.788586 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.788559 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65d7c64d77-lz24s"] Jun 09 11:47:33.866771 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866713 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6115979a-bd36-4047-b342-a53ad2da54df-audit-log\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.866930 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866787 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn4w7\" (UniqueName: \"kubernetes.io/projected/6115979a-bd36-4047-b342-a53ad2da54df-kube-api-access-kn4w7\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.866930 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866861 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-metrics-server-audit-profiles\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.866930 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866912 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.867054 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866944 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-client-certs\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.867054 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866969 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-tls\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.867054 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.866998 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-client-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967452 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967423 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-metrics-server-audit-profiles\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967485 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-client-certs\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967658 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-tls\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967694 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-client-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967794 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6115979a-bd36-4047-b342-a53ad2da54df-audit-log\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.967965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.967840 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn4w7\" (UniqueName: \"kubernetes.io/projected/6115979a-bd36-4047-b342-a53ad2da54df-kube-api-access-kn4w7\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.968395 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.968242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/6115979a-bd36-4047-b342-a53ad2da54df-audit-log\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.968676 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.968652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-metrics-server-audit-profiles\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.968788 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.968737 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6115979a-bd36-4047-b342-a53ad2da54df-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.970596 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.970573 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-client-certs\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.970727 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.970580 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-secret-metrics-server-tls\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.970877 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.970860 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/6115979a-bd36-4047-b342-a53ad2da54df-client-ca-bundle\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:33.977407 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:33.977381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn4w7\" (UniqueName: \"kubernetes.io/projected/6115979a-bd36-4047-b342-a53ad2da54df-kube-api-access-kn4w7\") pod \"metrics-server-65d7c64d77-lz24s\" (UID: \"6115979a-bd36-4047-b342-a53ad2da54df\") " pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:34.086217 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.086116 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:34.243558 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.243467 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-65d7c64d77-lz24s"] Jun 09 11:47:34.245936 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.245900 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:34.246485 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:34.246454 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6115979a_bd36_4047_b342_a53ad2da54df.slice/crio-20792d43fd4a4c81ba92b80e50ad6429bd5656916f899a6be8c6267a5a2714d8 WatchSource:0}: Error finding container 20792d43fd4a4c81ba92b80e50ad6429bd5656916f899a6be8c6267a5a2714d8: Status 404 returned error can't find the container with id 20792d43fd4a4c81ba92b80e50ad6429bd5656916f899a6be8c6267a5a2714d8 Jun 09 11:47:34.311387 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.311343 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:34.422291 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.422208 2562 patch_prober.go:28] interesting pod/image-registry-56c85fdc47-49ncv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:47:34.422291 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.422277 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:47:34.651540 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.651501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:34.685920 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.685834 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:47:34.693813 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.693781 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-676575f8bc-hhqm2"] Jun 09 11:47:34.697785 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.697118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.700167 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700117 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 11:47:34.700167 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700138 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 11:47:34.700431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700190 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 11:47:34.700431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700198 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 11:47:34.700561 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700492 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-xbqph\"" Jun 09 11:47:34.700822 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.700806 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 11:47:34.705261 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.705232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 11:47:34.715427 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.715363 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676575f8bc-hhqm2"] Jun 09 11:47:34.776141 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776141 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776126 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776404 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776255 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776404 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776298 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776404 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlklv\" (UniqueName: \"kubernetes.io/projected/138d7514-3519-4fa3-b2fb-159cd43d73e6-kube-api-access-wlklv\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776404 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-serving-certs-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776404 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-federate-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.776673 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.776454 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-metrics-client-ca\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.877950 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.877912 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-metrics-client-ca\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878126 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.877992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:47:34.878126 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878043 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878126 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878284 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878284 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878172 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878284 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878198 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlklv\" (UniqueName: \"kubernetes.io/projected/138d7514-3519-4fa3-b2fb-159cd43d73e6-kube-api-access-wlklv\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878284 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-serving-certs-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.878488 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878298 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-federate-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.879039 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.878821 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-metrics-client-ca\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.879271 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.879242 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.879729 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.879700 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/138d7514-3519-4fa3-b2fb-159cd43d73e6-serving-certs-ca-bundle\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.880839 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.880819 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/45100e9a-1edb-470f-80e8-610e52b80030-metrics-certs\") pod \"network-metrics-daemon-6qzc6\" (UID: \"45100e9a-1edb-470f-80e8-610e52b80030\") " pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:47:34.881000 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.880984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-telemeter-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.881202 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.881182 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.881269 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.881250 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-secret-telemeter-client\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.881310 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.881269 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/138d7514-3519-4fa3-b2fb-159cd43d73e6-federate-client-tls\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.888344 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.888317 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlklv\" (UniqueName: \"kubernetes.io/projected/138d7514-3519-4fa3-b2fb-159cd43d73e6-kube-api-access-wlklv\") pod \"telemeter-client-676575f8bc-hhqm2\" (UID: \"138d7514-3519-4fa3-b2fb-159cd43d73e6\") " pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:34.959872 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:34.959838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" event={"ID":"6115979a-bd36-4047-b342-a53ad2da54df","Type":"ContainerStarted","Data":"20792d43fd4a4c81ba92b80e50ad6429bd5656916f899a6be8c6267a5a2714d8"} Jun 09 11:47:35.012005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.011969 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" Jun 09 11:47:35.046954 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.046920 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bf68m\"" Jun 09 11:47:35.055386 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.055347 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-6qzc6" Jun 09 11:47:35.202535 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.202458 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-676575f8bc-hhqm2"] Jun 09 11:47:35.224401 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:35.224368 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod138d7514_3519_4fa3_b2fb_159cd43d73e6.slice/crio-ebeb500fa481267f8f24193e15c2b18ffc7eba30ad544d6e70ebd4dc326c7ee8 WatchSource:0}: Error finding container ebeb500fa481267f8f24193e15c2b18ffc7eba30ad544d6e70ebd4dc326c7ee8: Status 404 returned error can't find the container with id ebeb500fa481267f8f24193e15c2b18ffc7eba30ad544d6e70ebd4dc326c7ee8 Jun 09 11:47:35.256118 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.255913 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-6qzc6"] Jun 09 11:47:35.258834 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:35.258796 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45100e9a_1edb_470f_80e8_610e52b80030.slice/crio-14fa8d446b21f9fe766ceb7fe40ab665e566e29fb1e553e8e26014e7df2581c1 WatchSource:0}: Error finding container 14fa8d446b21f9fe766ceb7fe40ab665e566e29fb1e553e8e26014e7df2581c1: Status 404 returned error can't find the container with id 14fa8d446b21f9fe766ceb7fe40ab665e566e29fb1e553e8e26014e7df2581c1 Jun 09 11:47:35.552670 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.552624 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:35.617327 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.617291 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:35.720373 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.720335 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:35.724951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.724919 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:47:35.728860 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.728831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.736165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.735929 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 11:47:35.736165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736016 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-cdbqtajg8h7m1\"" Jun 09 11:47:35.736165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736022 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 11:47:35.736165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736105 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-pm2kb\"" Jun 09 11:47:35.736611 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 11:47:35.736964 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736715 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 11:47:35.736964 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736824 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 11:47:35.736964 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736835 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 11:47:35.736964 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.736851 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 11:47:35.737234 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.737118 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 11:47:35.737324 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.737302 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 11:47:35.737810 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.737363 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 11:47:35.738792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.738599 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 11:47:35.739375 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.739354 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 11:47:35.745290 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.739356 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 11:47:35.752265 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.752232 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 11:47:35.753060 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.753031 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790110 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790185 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790237 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790295 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790317 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krzth\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-kube-api-access-krzth\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790340 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790389 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790421 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790455 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790482 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790508 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790533 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790564 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.790775 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790585 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.791532 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790613 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.791532 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.791532 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790880 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.791532 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.790917 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.891911 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892005 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.891977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892051 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892077 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892161 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892188 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892252 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892250 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892294 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892328 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892407 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892463 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892491 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892519 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892542 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krzth\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-kube-api-access-krzth\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.892637 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.892582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.894214 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.893313 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.894214 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.893644 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.894214 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.893827 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.894214 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.893906 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.895792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.894896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.895792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.895589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.895792 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.895709 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.896029 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.896001 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.897047 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.896997 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.897951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.897524 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.897951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.897846 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.897951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.897909 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.899317 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.898741 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.899317 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.899276 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.899470 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.899336 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.899531 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.899468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.899840 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.899818 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.900194 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.900155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.900497 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.900473 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.904294 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.904234 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krzth\" (UniqueName: \"kubernetes.io/projected/0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c-kube-api-access-krzth\") pod \"prometheus-k8s-0\" (UID: \"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:35.967082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.967038 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qzc6" event={"ID":"45100e9a-1edb-470f-80e8-610e52b80030","Type":"ContainerStarted","Data":"14fa8d446b21f9fe766ceb7fe40ab665e566e29fb1e553e8e26014e7df2581c1"} Jun 09 11:47:35.968673 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.968634 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" event={"ID":"138d7514-3519-4fa3-b2fb-159cd43d73e6","Type":"ContainerStarted","Data":"ebeb500fa481267f8f24193e15c2b18ffc7eba30ad544d6e70ebd4dc326c7ee8"} Jun 09 11:47:35.972799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.972537 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"332b0ec804caacf0261d58397fcc83fe2b79568d2decffef0df7ac20fce0e103"} Jun 09 11:47:35.972799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.972619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"86fb0344f656bf50f6129e984e4792e60d5a1ca8e8723fec0a3a299dad2fbe6e"} Jun 09 11:47:35.972799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.972647 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"7cb71602a3809cf34841616ac2210960cf3d8994306882c433f166a5475b83ab"} Jun 09 11:47:35.972799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.972672 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"5326083eb4198974f5edf936ab0946b129d9ef4f5039aed811c1c5cfff3d395f"} Jun 09 11:47:35.972799 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:35.972696 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"ecdcb0fe370eebd5378159f0ccdc13c446923a289cf279d874b44bfe4d338ebe"} Jun 09 11:47:36.051187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.051144 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:36.270882 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.270778 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:47:36.273270 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:47:36.273232 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c609fbd_66aa_4fff_87b4_1cdbb6b2ea7c.slice/crio-4ad8e87ccdca1f77b16b655da98616270abe936c93f46e797419ecdca0b62585 WatchSource:0}: Error finding container 4ad8e87ccdca1f77b16b655da98616270abe936c93f46e797419ecdca0b62585: Status 404 returned error can't find the container with id 4ad8e87ccdca1f77b16b655da98616270abe936c93f46e797419ecdca0b62585 Jun 09 11:47:36.980028 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.979954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" event={"ID":"6115979a-bd36-4047-b342-a53ad2da54df","Type":"ContainerStarted","Data":"488724b16e3de5cdd5eff5082f196d70b6bfec2df2ac6a86f7ac77ce94f52f3c"} Jun 09 11:47:36.982142 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.982113 2562 generic.go:356] "Generic (PLEG): container finished" podID="0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c" containerID="436373f0fb1d7b3a9113a289b75a4e76ec0962b7ad879cee4c54a3304b8c18d3" exitCode=0 Jun 09 11:47:36.982234 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.982159 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerDied","Data":"436373f0fb1d7b3a9113a289b75a4e76ec0962b7ad879cee4c54a3304b8c18d3"} Jun 09 11:47:36.982234 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.982227 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"4ad8e87ccdca1f77b16b655da98616270abe936c93f46e797419ecdca0b62585"} Jun 09 11:47:36.997082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:36.997017 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" podStartSLOduration=2.140422015 podStartE2EDuration="3.996992599s" totalImagesPullingTime="1.856570584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:36.996923322 +0000 UTC m=+253.497778512" watchObservedRunningTime="2026-06-09 11:47:36.996992599 +0000 UTC m=+253.497847787" Jun 09 11:47:37.968425 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.968186 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:37.968425 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.968315 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:47:37.970140 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.969771 2562 patch_prober.go:28] interesting pod/console-7d98766c56-wl5rw container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" start-of-body= Jun 09 11:47:37.970140 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.969855 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d98766c56-wl5rw" podUID="401dd085-32c5-432f-9afe-bef6302cb450" containerName="console" probeResult="failure" output="Get \"https://10.134.0.20:8443/health\": dial tcp 10.134.0.20:8443: connect: connection refused" Jun 09 11:47:37.991848 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.991792 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qzc6" event={"ID":"45100e9a-1edb-470f-80e8-610e52b80030","Type":"ContainerStarted","Data":"5be778965469393f6cfa24ad4d74d035e42fb1ae61a975eed2f02ae29c1d268f"} Jun 09 11:47:37.992017 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:37.991868 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-6qzc6" event={"ID":"45100e9a-1edb-470f-80e8-610e52b80030","Type":"ContainerStarted","Data":"0a3f50b1ede6cec88fae310efcf13f5f9935cdef2b75ce89f621f15ae1b677d4"} Jun 09 11:47:38.002457 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:38.002410 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"f43616f7-ef35-4713-b12d-23c6ad5ae668","Type":"ContainerStarted","Data":"904e524d37d3518e580bca2c153f7f2b977afcbb77e3bf8d8fd76fcfb39dc8da"} Jun 09 11:47:38.011439 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:38.011380 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-6qzc6" podStartSLOduration=252.310134837 podStartE2EDuration="4m14.011358072s" totalImagesPullingTime="1.701223235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:38.009876544 +0000 UTC m=+254.510731737" watchObservedRunningTime="2026-06-09 11:47:38.011358072 +0000 UTC m=+254.512213261" Jun 09 11:47:38.042470 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:38.042106 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.449329337 podStartE2EDuration="8.042087228s" totalImagesPullingTime="4.576536198s" totalInitContainerRuntime="16.221693ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:38.039176532 +0000 UTC m=+254.540031720" watchObservedRunningTime="2026-06-09 11:47:38.042087228 +0000 UTC m=+254.542942431" Jun 09 11:47:38.164235 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:38.164149 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:38.264704 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:38.264671 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:39.013507 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.013467 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" event={"ID":"138d7514-3519-4fa3-b2fb-159cd43d73e6","Type":"ContainerStarted","Data":"b9573e16936207485c25b243fb50f54c1508b19db0aae97dec04cea94f9bdf87"} Jun 09 11:47:39.014038 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.013543 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" event={"ID":"138d7514-3519-4fa3-b2fb-159cd43d73e6","Type":"ContainerStarted","Data":"da330273871e7f5d7ea1cc9fa3c239aca0755661b9dd91b5b4e79775534438d8"} Jun 09 11:47:39.014038 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.013572 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" event={"ID":"138d7514-3519-4fa3-b2fb-159cd43d73e6","Type":"ContainerStarted","Data":"bfee980e2d6062073184fc4ed4d248fa7a1f59cd3cd12367cc1e232002cce335"} Jun 09 11:47:39.037831 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.037763 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-676575f8bc-hhqm2" podStartSLOduration=2.208287232 podStartE2EDuration="5.037721027s" totalImagesPullingTime="2.829433795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:39.036264381 +0000 UTC m=+255.537119594" watchObservedRunningTime="2026-06-09 11:47:39.037721027 +0000 UTC m=+255.538576217" Jun 09 11:47:39.135278 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.135212 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:47:39.329663 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.329514 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:39.387577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.387527 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:39.440841 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.440803 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" containerID="cri-o://4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb" gracePeriod=30 Jun 09 11:47:39.974153 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:39.974096 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:40.074548 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.074511 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:40.195606 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.195578 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:40.260174 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260138 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260237 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260284 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260309 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260347 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85mzc\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260591 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260369 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260591 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260397 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260591 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260418 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets\") pod \"88106101-3896-485f-abf1-80da6473eb5d\" (UID: \"88106101-3896-485f-abf1-80da6473eb5d\") " Jun 09 11:47:40.260591 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260574 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:47:40.260976 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.260817 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-trusted-ca\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.261491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.261462 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:47:40.263671 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.263628 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:47:40.264425 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.264382 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:47:40.264512 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.264484 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:47:40.264562 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.264549 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:47:40.264653 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.264626 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc" (OuterVolumeSpecName: "kube-api-access-85mzc") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "kube-api-access-85mzc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:47:40.270879 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.270840 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "88106101-3896-485f-abf1-80da6473eb5d" (UID: "88106101-3896-485f-abf1-80da6473eb5d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:47:40.362291 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362250 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/88106101-3896-485f-abf1-80da6473eb5d-registry-certificates\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362291 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362293 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-image-registry-private-configuration\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362538 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362310 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85mzc\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-kube-api-access-85mzc\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362538 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362326 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-registry-tls\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362538 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362341 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/88106101-3896-485f-abf1-80da6473eb5d-ca-trust-extracted\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362538 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362354 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/88106101-3896-485f-abf1-80da6473eb5d-installation-pull-secrets\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:40.362538 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:40.362369 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/88106101-3896-485f-abf1-80da6473eb5d-bound-sa-token\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:47:41.026258 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.026216 2562 generic.go:356] "Generic (PLEG): container finished" podID="88106101-3896-485f-abf1-80da6473eb5d" containerID="4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb" exitCode=0 Jun 09 11:47:41.026458 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.026268 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" Jun 09 11:47:41.026458 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.026311 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" event={"ID":"88106101-3896-485f-abf1-80da6473eb5d","Type":"ContainerDied","Data":"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb"} Jun 09 11:47:41.026458 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.026367 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-56c85fdc47-49ncv" event={"ID":"88106101-3896-485f-abf1-80da6473eb5d","Type":"ContainerDied","Data":"f91e3f534aa9280a809a5ce1d5d0f04e0ef0d7413b60b7f535f81a6c162367f8"} Jun 09 11:47:41.026458 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.026394 2562 scope.go:117] "RemoveContainer" containerID="4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb" Jun 09 11:47:41.029938 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.029903 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"222a9c10814234f15d026cdfc5d251ffa038b3d9387662ff8b98a82510fe3f51"} Jun 09 11:47:41.030082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.029987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"581cf7232dd9b2db9aa711d95e042d23bee750dcdd78b88edd249b4499058f6c"} Jun 09 11:47:41.037927 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.037903 2562 scope.go:117] "RemoveContainer" containerID="4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb" Jun 09 11:47:41.038283 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:47:41.038258 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb\": container with ID starting with 4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb not found: ID does not exist" containerID="4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb" Jun 09 11:47:41.038376 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.038296 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb"} err="failed to get container status \"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb\": rpc error: code = NotFound desc = could not find container \"4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb\": container with ID starting with 4d86b69da7575282e2fc10878b084da602385eded1f6bdbaefa6ced438cdd1bb not found: ID does not exist" Jun 09 11:47:41.051368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.051327 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:47:41.054641 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.054610 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-56c85fdc47-49ncv"] Jun 09 11:47:41.953553 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:41.953511 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88106101-3896-485f-abf1-80da6473eb5d" path="/var/lib/kubelet/pods/88106101-3896-485f-abf1-80da6473eb5d/volumes" Jun 09 11:47:43.046402 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.046366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"bfe89cebcf10f898d3ed18d951b66c817e113ef5b5c02be047883329cf0b9a66"} Jun 09 11:47:43.046815 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.046462 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"a980641e2013cb190918d3f6a826d0cc15d0676f9bf182c4c13d5fd2c1f889e9"} Jun 09 11:47:43.046815 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.046489 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"d8ad491fac4dd20e3d9499e36067ec80e3a226ad1a1aab8ae01fe8fb6fd4a346"} Jun 09 11:47:43.046815 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.046515 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c","Type":"ContainerStarted","Data":"2fc600cbdee382731d7824278ac1f642d6060ddccda497ce8034ed844b7d9f0e"} Jun 09 11:47:43.075725 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.075649 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.941492561 podStartE2EDuration="8.075627118s" totalImagesPullingTime="5.108732274s" totalInitContainerRuntime="25.402283ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:47:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:47:43.073428378 +0000 UTC m=+259.574283577" watchObservedRunningTime="2026-06-09 11:47:43.075627118 +0000 UTC m=+259.576482307" Jun 09 11:47:43.879000 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.878965 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:43.941209 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:43.941177 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:45.042484 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:45.042422 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:46.052124 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:46.052090 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:47:50.128972 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:50.128936 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:50.229953 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:50.229915 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:54.087167 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:54.087123 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:54.087577 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:54.087196 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:47:54.594095 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:54.594047 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:58.425806 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:58.425741 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:58.490465 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:58.490428 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.380391 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.380354 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.452627 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.452591 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.714260 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.714223 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-745ffccbd8-src4n" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerName="console" containerID="cri-o://2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1" gracePeriod=15 Jun 09 11:47:59.723484 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.723455 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.821929 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.821896 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.922827 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.922769 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.972761 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:47:59.972680 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:48:00.052079 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052045 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42ffm\" (UniqueName: \"kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052274 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052106 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052274 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052243 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052394 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052356 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052444 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052393 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052444 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config\") pod \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\" (UID: \"2fff8e3f-135b-4fed-9de9-0ec5974fd189\") " Jun 09 11:48:00.052552 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052526 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:00.052795 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052764 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:00.052893 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052776 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-oauth-serving-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:00.052965 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.052931 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config" (OuterVolumeSpecName: "console-config") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:00.054682 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.054659 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:48:00.054806 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.054782 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:48:00.055148 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.055108 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm" (OuterVolumeSpecName: "kube-api-access-42ffm") pod "2fff8e3f-135b-4fed-9de9-0ec5974fd189" (UID: "2fff8e3f-135b-4fed-9de9-0ec5974fd189"). InnerVolumeSpecName "kube-api-access-42ffm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:48:00.071595 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.071564 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:00.118158 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.118123 2562 generic.go:356] "Generic (PLEG): container finished" podID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerID="2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1" exitCode=0 Jun 09 11:48:00.118313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.118178 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-745ffccbd8-src4n" Jun 09 11:48:00.118313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.118221 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745ffccbd8-src4n" event={"ID":"2fff8e3f-135b-4fed-9de9-0ec5974fd189","Type":"ContainerDied","Data":"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1"} Jun 09 11:48:00.118313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.118279 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-745ffccbd8-src4n" event={"ID":"2fff8e3f-135b-4fed-9de9-0ec5974fd189","Type":"ContainerDied","Data":"196ec20333817a3c173552647404736ce88dd0479d876b133beef1fbf224746c"} Jun 09 11:48:00.118313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.118304 2562 scope.go:117] "RemoveContainer" containerID="2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1" Jun 09 11:48:00.123939 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.123894 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:00.128144 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.128121 2562 scope.go:117] "RemoveContainer" containerID="2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1" Jun 09 11:48:00.128424 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:48:00.128406 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1\": container with ID starting with 2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1 not found: ID does not exist" containerID="2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1" Jun 09 11:48:00.128468 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.128432 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1"} err="failed to get container status \"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1\": rpc error: code = NotFound desc = could not find container \"2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1\": container with ID starting with 2b14a1d9dfcabbbe93ca4fa84f610f1f7f7bc13611ea397443d61b56a249d2a1 not found: ID does not exist" Jun 09 11:48:00.138287 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.138256 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:48:00.143963 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.143933 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-745ffccbd8-src4n"] Jun 09 11:48:00.153278 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.153256 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-config\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:00.153278 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.153280 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42ffm\" (UniqueName: \"kubernetes.io/projected/2fff8e3f-135b-4fed-9de9-0ec5974fd189-kube-api-access-42ffm\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:00.153431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.153290 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-oauth-config\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:00.153431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.153301 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fff8e3f-135b-4fed-9de9-0ec5974fd189-service-ca\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:00.153431 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:00.153311 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fff8e3f-135b-4fed-9de9-0ec5974fd189-console-serving-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:01.949308 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:01.949271 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" path="/var/lib/kubelet/pods/2fff8e3f-135b-4fed-9de9-0ec5974fd189/volumes" Jun 09 11:48:03.213904 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:03.213871 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8xcd_6f71d7f7-9784-406e-84e6-432a0abafec5/dns-node-resolver/0.log" Jun 09 11:48:03.613328 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:03.613296 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48qdm_622abbef-221f-479b-bca1-cd2e3e2eff02/serve-healthcheck-canary/0.log" Jun 09 11:48:04.160760 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.160681 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d98766c56-wl5rw" podUID="401dd085-32c5-432f-9afe-bef6302cb450" containerName="console" containerID="cri-o://a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698" gracePeriod=15 Jun 09 11:48:04.399391 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.399365 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:48:04.495241 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495198 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495441 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495260 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wszr2\" (UniqueName: \"kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495441 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495292 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495573 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495456 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495573 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495525 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495573 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495565 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495611 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config\") pod \"401dd085-32c5-432f-9afe-bef6302cb450\" (UID: \"401dd085-32c5-432f-9afe-bef6302cb450\") " Jun 09 11:48:04.495724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495676 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:04.495724 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495690 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:04.496009 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495961 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-oauth-serving-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.496009 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495986 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-trusted-ca-bundle\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.496009 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.495958 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config" (OuterVolumeSpecName: "console-config") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:04.496161 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.496001 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca" (OuterVolumeSpecName: "service-ca") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:48:04.497804 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.497770 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:48:04.497904 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.497844 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2" (OuterVolumeSpecName: "kube-api-access-wszr2") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "kube-api-access-wszr2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:48:04.497904 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.497853 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "401dd085-32c5-432f-9afe-bef6302cb450" (UID: "401dd085-32c5-432f-9afe-bef6302cb450"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:48:04.597187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.597145 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wszr2\" (UniqueName: \"kubernetes.io/projected/401dd085-32c5-432f-9afe-bef6302cb450-kube-api-access-wszr2\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.597187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.597177 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-serving-cert\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.597187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.597188 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-console-config\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.597187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.597196 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/401dd085-32c5-432f-9afe-bef6302cb450-service-ca\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.597444 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.597204 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/401dd085-32c5-432f-9afe-bef6302cb450-console-oauth-config\") on node \"ip-10-0-138-33.ec2.internal\" DevicePath \"\"" Jun 09 11:48:04.958346 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:04.958255 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:05.031257 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.031215 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:05.142899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.142867 2562 generic.go:356] "Generic (PLEG): container finished" podID="401dd085-32c5-432f-9afe-bef6302cb450" containerID="a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698" exitCode=0 Jun 09 11:48:05.143074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.142914 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d98766c56-wl5rw" Jun 09 11:48:05.143074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.142971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d98766c56-wl5rw" event={"ID":"401dd085-32c5-432f-9afe-bef6302cb450","Type":"ContainerDied","Data":"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698"} Jun 09 11:48:05.143074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.143018 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d98766c56-wl5rw" event={"ID":"401dd085-32c5-432f-9afe-bef6302cb450","Type":"ContainerDied","Data":"5690b207e1e17cbf162d870d978d66af230be4a8bf238f5713afaf7f25ce5aac"} Jun 09 11:48:05.143074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.143041 2562 scope.go:117] "RemoveContainer" containerID="a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698" Jun 09 11:48:05.153168 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.153150 2562 scope.go:117] "RemoveContainer" containerID="a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698" Jun 09 11:48:05.153524 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:48:05.153504 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698\": container with ID starting with a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698 not found: ID does not exist" containerID="a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698" Jun 09 11:48:05.153562 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.153536 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698"} err="failed to get container status \"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698\": rpc error: code = NotFound desc = could not find container \"a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698\": container with ID starting with a1baf8eb123949c69b612f354019000df233b6c389e9f9915237c2ac91881698 not found: ID does not exist" Jun 09 11:48:05.156525 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.156501 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:05.165165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.165135 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:48:05.169018 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.168985 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d98766c56-wl5rw"] Jun 09 11:48:05.258187 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.258154 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:05.948640 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:05.948608 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="401dd085-32c5-432f-9afe-bef6302cb450" path="/var/lib/kubelet/pods/401dd085-32c5-432f-9afe-bef6302cb450/volumes" Jun 09 11:48:06.634329 ip-10-0-138-33 kubenswrapper[2562]: E0609 11:48:06.634285 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6vhbc" podUID="77caa6f0-d5ca-42b3-9f4b-82b143a651fa" Jun 09 11:48:07.151892 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:07.151861 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:07.689056 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:07.689023 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:07.746415 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:07.746372 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:09.946011 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:09.945977 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:09.948689 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:09.948663 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/77caa6f0-d5ca-42b3-9f4b-82b143a651fa-metrics-tls\") pod \"dns-default-6vhbc\" (UID: \"77caa6f0-d5ca-42b3-9f4b-82b143a651fa\") " pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:10.155190 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.155102 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-nkvst\"" Jun 09 11:48:10.163303 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.163259 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:10.165893 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.165857 2562 generic.go:356] "Generic (PLEG): container finished" podID="18c0d2c7-8ec5-4b50-a168-07e24ea02234" containerID="8e4534aed7e652e077d610ba3673789762eb60affa0fb5f79e6102d3055b5bca" exitCode=0 Jun 09 11:48:10.166014 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.165924 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" event={"ID":"18c0d2c7-8ec5-4b50-a168-07e24ea02234","Type":"ContainerDied","Data":"8e4534aed7e652e077d610ba3673789762eb60affa0fb5f79e6102d3055b5bca"} Jun 09 11:48:10.166309 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.166295 2562 scope.go:117] "RemoveContainer" containerID="8e4534aed7e652e077d610ba3673789762eb60affa0fb5f79e6102d3055b5bca" Jun 09 11:48:10.351191 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:10.350993 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6vhbc"] Jun 09 11:48:10.353385 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:48:10.353352 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77caa6f0_d5ca_42b3_9f4b_82b143a651fa.slice/crio-28214af9204a82048ed90d06326192cbe617fdc3452bfb3ec4b8d2ca6a6798a9 WatchSource:0}: Error finding container 28214af9204a82048ed90d06326192cbe617fdc3452bfb3ec4b8d2ca6a6798a9: Status 404 returned error can't find the container with id 28214af9204a82048ed90d06326192cbe617fdc3452bfb3ec4b8d2ca6a6798a9 Jun 09 11:48:11.173357 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:11.173307 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vhbc" event={"ID":"77caa6f0-d5ca-42b3-9f4b-82b143a651fa","Type":"ContainerStarted","Data":"28214af9204a82048ed90d06326192cbe617fdc3452bfb3ec4b8d2ca6a6798a9"} Jun 09 11:48:11.175821 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:11.175788 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-wz7t7" event={"ID":"18c0d2c7-8ec5-4b50-a168-07e24ea02234","Type":"ContainerStarted","Data":"aa72edb02c8bbb5510c651b08020758419bad821da677e8d753dc0c1c85b2d42"} Jun 09 11:48:13.187641 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:13.187546 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vhbc" event={"ID":"77caa6f0-d5ca-42b3-9f4b-82b143a651fa","Type":"ContainerStarted","Data":"4a6441bff7f3da39ec2f59c8a52f3ebf0ee7056c7cb24fbcb38ef3dec01e6783"} Jun 09 11:48:13.187641 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:13.187617 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6vhbc" event={"ID":"77caa6f0-d5ca-42b3-9f4b-82b143a651fa","Type":"ContainerStarted","Data":"b1d6bdf379214c404da2968d39cba710e48368bcabd7df646367ae8e8e76a219"} Jun 09 11:48:13.188058 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:13.187720 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:13.209512 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:13.209458 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6vhbc" podStartSLOduration=252.112681111 podStartE2EDuration="4m14.209436584s" totalImagesPullingTime="2.096755473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:43:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:13.207622309 +0000 UTC m=+289.708477496" watchObservedRunningTime="2026-06-09 11:48:13.209436584 +0000 UTC m=+289.710291772" Jun 09 11:48:13.933707 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:13.933552 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:14.047983 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:14.047925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:14.092830 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:14.092801 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:48:14.099355 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:14.099323 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-65d7c64d77-lz24s" Jun 09 11:48:15.277315 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:15.277282 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:15.340692 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:15.340656 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:16.875032 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:16.874982 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:16.976221 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:16.976182 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:20.817713 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:20.817674 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:20.957899 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:20.957865 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:21.057204 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:21.057166 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:21.452519 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:21.452480 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:21.557074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:21.557041 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:23.195298 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.195269 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6vhbc" Jun 09 11:48:23.897928 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.897894 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:48:23.901466 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.901411 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:48:23.910145 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.910099 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:48:23.912110 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.912090 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:48:23.914313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:23.914295 2562 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 11:48:28.878508 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:28.878476 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:28.949352 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:28.949306 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:32.327654 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:32.327615 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:32.377704 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:32.377667 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:36.052245 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:36.052197 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:48:36.073018 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:36.072986 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:48:36.305673 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:36.305588 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:48:42.270336 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:42.270298 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:42.325398 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:42.325365 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:43.874949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:43.874920 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:43.928925 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:43.928888 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:45.566285 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:45.566245 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:45.668696 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:45.668653 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:50.078973 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:50.078931 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:54.056334 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:54.056289 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:54.156826 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:54.156789 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.885475 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:58.885442 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.986099 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:48:58.986061 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.374962 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:01.374925 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.429479 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:01.429404 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.484092 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:01.484060 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:06.639741 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:06.639707 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:06.690046 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:06.690012 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:31.620425 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:31.620336 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:31.678633 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:31.678590 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:33.585619 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:33.585586 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:55.562561 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562521 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh4n/must-gather-z6vhr"] Jun 09 11:49:55.562979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562944 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" Jun 09 11:49:55.562979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562959 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" Jun 09 11:49:55.562979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562975 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerName="console" Jun 09 11:49:55.562979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562980 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerName="console" Jun 09 11:49:55.563112 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562989 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="401dd085-32c5-432f-9afe-bef6302cb450" containerName="console" Jun 09 11:49:55.563112 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.562995 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="401dd085-32c5-432f-9afe-bef6302cb450" containerName="console" Jun 09 11:49:55.563112 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.563055 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="401dd085-32c5-432f-9afe-bef6302cb450" containerName="console" Jun 09 11:49:55.563112 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.563063 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="88106101-3896-485f-abf1-80da6473eb5d" containerName="registry" Jun 09 11:49:55.563112 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.563070 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2fff8e3f-135b-4fed-9de9-0ec5974fd189" containerName="console" Jun 09 11:49:55.565614 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.565577 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:55.566144 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.566129 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.568280 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.568263 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh4n\"/\"kube-root-ca.crt\"" Jun 09 11:49:55.568362 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.568261 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hlh4n\"/\"default-dockercfg-fx9ng\"" Jun 09 11:49:55.568949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.568926 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hlh4n\"/\"openshift-service-ca.crt\"" Jun 09 11:49:55.572559 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.572537 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh4n/must-gather-z6vhr"] Jun 09 11:49:55.669848 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.669807 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:55.682242 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.682215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4lch\" (UniqueName: \"kubernetes.io/projected/869105ef-437e-48b6-becf-ba8a71b4a8f9-kube-api-access-h4lch\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.682349 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.682272 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/869105ef-437e-48b6-becf-ba8a71b4a8f9-must-gather-output\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.783133 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.783091 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4lch\" (UniqueName: \"kubernetes.io/projected/869105ef-437e-48b6-becf-ba8a71b4a8f9-kube-api-access-h4lch\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.783308 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.783148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/869105ef-437e-48b6-becf-ba8a71b4a8f9-must-gather-output\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.783505 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.783487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/869105ef-437e-48b6-becf-ba8a71b4a8f9-must-gather-output\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.791491 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.791468 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4lch\" (UniqueName: \"kubernetes.io/projected/869105ef-437e-48b6-becf-ba8a71b4a8f9-kube-api-access-h4lch\") pod \"must-gather-z6vhr\" (UID: \"869105ef-437e-48b6-becf-ba8a71b4a8f9\") " pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:55.885865 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:55.885777 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" Jun 09 11:49:56.026464 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:56.026344 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh4n/must-gather-z6vhr"] Jun 09 11:49:56.029374 ip-10-0-138-33 kubenswrapper[2562]: W0609 11:49:56.029346 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod869105ef_437e_48b6_becf_ba8a71b4a8f9.slice/crio-477efeb1d504a0f5cc6d1a576696a8836cedab962e2dc8a045a53d778a9bf989 WatchSource:0}: Error finding container 477efeb1d504a0f5cc6d1a576696a8836cedab962e2dc8a045a53d778a9bf989: Status 404 returned error can't find the container with id 477efeb1d504a0f5cc6d1a576696a8836cedab962e2dc8a045a53d778a9bf989 Jun 09 11:49:56.031297 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:56.031277 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:49:56.623189 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:56.623153 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" event={"ID":"869105ef-437e-48b6-becf-ba8a71b4a8f9","Type":"ContainerStarted","Data":"477efeb1d504a0f5cc6d1a576696a8836cedab962e2dc8a045a53d778a9bf989"} Jun 09 11:49:57.630949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:57.630862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" event={"ID":"869105ef-437e-48b6-becf-ba8a71b4a8f9","Type":"ContainerStarted","Data":"6fa27d9a359e4046a83ac7fd948ff00af8112ea2f1db2ab15e4c92127ec03ba6"} Jun 09 11:49:57.630949 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:57.630917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" event={"ID":"869105ef-437e-48b6-becf-ba8a71b4a8f9","Type":"ContainerStarted","Data":"5d2ed7969504b962a2a1ef84152423fa85172fd46ec99b9a578987b5e3a7f8a4"} Jun 09 11:49:57.651789 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:57.648226 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh4n/must-gather-z6vhr" podStartSLOduration=1.899916975 podStartE2EDuration="2.648205691s" totalImagesPullingTime="748.288716ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:57.647798618 +0000 UTC m=+394.148653805" watchObservedRunningTime="2026-06-09 11:49:57.648205691 +0000 UTC m=+394.149060882" Jun 09 11:49:58.212419 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:58.212391 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gzdxb_69b2b4f5-5160-438e-a27a-898f05a45442/global-pull-secret-syncer/0.log" Jun 09 11:49:58.260623 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:58.260590 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" Jun 09 11:49:58.361025 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:49:58.360998 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-33.ec2.internal_a3f1a7132c9e3bee9e3dcb2cfeacf2f7/haproxy/0.log" Jun 09 11:50:02.303240 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.303211 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/alertmanager/0.log" Jun 09 11:50:02.334007 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.333966 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/config-reloader/0.log" Jun 09 11:50:02.359541 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.359509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/kube-rbac-proxy-web/0.log" Jun 09 11:50:02.423298 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.423263 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/kube-rbac-proxy/0.log" Jun 09 11:50:02.486765 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.486712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/kube-rbac-proxy-metric/0.log" Jun 09 11:50:02.525920 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.525884 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/prom-label-proxy/0.log" Jun 09 11:50:02.554050 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.553937 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_f43616f7-ef35-4713-b12d-23c6ad5ae668/init-config-reloader/0.log" Jun 09 11:50:02.593582 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.593537 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-9gk5b_5f0bb332-9a3e-4fa0-a019-59fcbfd0dc3c/cluster-monitoring-operator/0.log" Jun 09 11:50:02.716152 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.716118 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-65d7c64d77-lz24s_6115979a-bd36-4047-b342-a53ad2da54df/metrics-server/0.log" Jun 09 11:50:02.863362 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.863275 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jv4wx_6323204d-1056-4e80-8fa8-c0942ba4bf71/node-exporter/0.log" Jun 09 11:50:02.888903 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.888859 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jv4wx_6323204d-1056-4e80-8fa8-c0942ba4bf71/kube-rbac-proxy/0.log" Jun 09 11:50:02.914357 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:02.914329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jv4wx_6323204d-1056-4e80-8fa8-c0942ba4bf71/init-textfile/0.log" Jun 09 11:50:03.117832 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.117712 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/prometheus/0.log" Jun 09 11:50:03.143979 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.143940 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/config-reloader/0.log" Jun 09 11:50:03.171006 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.170975 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/thanos-sidecar/0.log" Jun 09 11:50:03.213785 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.205695 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/kube-rbac-proxy-web/0.log" Jun 09 11:50:03.230723 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.230675 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/kube-rbac-proxy/0.log" Jun 09 11:50:03.259602 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.259572 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/kube-rbac-proxy-thanos/0.log" Jun 09 11:50:03.286770 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.285518 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c609fbd-66aa-4fff-87b4-1cdbb6b2ea7c/init-config-reloader/0.log" Jun 09 11:50:03.320718 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.320688 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nd4gc_111ca4f5-cc34-4722-8b23-bd955f820406/prometheus-operator/0.log" Jun 09 11:50:03.343594 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.343561 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nd4gc_111ca4f5-cc34-4722-8b23-bd955f820406/kube-rbac-proxy/0.log" Jun 09 11:50:03.375148 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.375059 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-j7wh8_0374e593-87e5-4443-88eb-6a73db1a6878/prometheus-operator-admission-webhook/0.log" Jun 09 11:50:03.414777 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.414459 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676575f8bc-hhqm2_138d7514-3519-4fa3-b2fb-159cd43d73e6/telemeter-client/0.log" Jun 09 11:50:03.442482 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.442445 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676575f8bc-hhqm2_138d7514-3519-4fa3-b2fb-159cd43d73e6/reload/0.log" Jun 09 11:50:03.469561 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:03.469529 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-676575f8bc-hhqm2_138d7514-3519-4fa3-b2fb-159cd43d73e6/kube-rbac-proxy/0.log" Jun 09 11:50:04.978363 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:04.978172 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-msnv5_c0ccf38e-6aa8-484f-8829-d5b2e5be0df7/networking-console-plugin/0.log" Jun 09 11:50:05.446082 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:05.446000 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/1.log" Jun 09 11:50:05.452365 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:05.452337 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-8rxqr_37a86ee5-3f59-419b-8786-9d74e68a7f47/console-operator/2.log" Jun 09 11:50:06.237186 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.237134 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s"] Jun 09 11:50:06.242856 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.242818 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.250282 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.250241 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s"] Jun 09 11:50:06.402368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.402163 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-proc\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.402368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.402222 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-lib-modules\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.402368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.402261 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-podres\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.402368 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.402325 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4dvb\" (UniqueName: \"kubernetes.io/projected/e5fd153c-0731-4a15-bb20-66cc7ca47f74-kube-api-access-g4dvb\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.402708 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.402470 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-sys\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.421623 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.421592 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-xw486_0325a29b-e44d-4c32-809a-ed5dda9aa254/volume-data-source-validator/0.log" Jun 09 11:50:06.503542 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.503440 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-proc\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.503767 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.503710 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-proc\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.503951 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.503922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-lib-modules\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.503978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-podres\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504074 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.504018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4dvb\" (UniqueName: \"kubernetes.io/projected/e5fd153c-0731-4a15-bb20-66cc7ca47f74-kube-api-access-g4dvb\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504152 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.504090 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-sys\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504186 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.504156 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-lib-modules\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504222 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.504183 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-podres\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.504255 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.504230 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5fd153c-0731-4a15-bb20-66cc7ca47f74-sys\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.513121 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.513065 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4dvb\" (UniqueName: \"kubernetes.io/projected/e5fd153c-0731-4a15-bb20-66cc7ca47f74-kube-api-access-g4dvb\") pod \"perf-node-gather-daemonset-hp42s\" (UID: \"e5fd153c-0731-4a15-bb20-66cc7ca47f74\") " pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.557001 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.556961 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:06.716113 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:06.716086 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s"] Jun 09 11:50:07.201418 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.201294 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vhbc_77caa6f0-d5ca-42b3-9f4b-82b143a651fa/dns/0.log" Jun 09 11:50:07.224419 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.224382 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6vhbc_77caa6f0-d5ca-42b3-9f4b-82b143a651fa/kube-rbac-proxy/0.log" Jun 09 11:50:07.390974 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.390946 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w8xcd_6f71d7f7-9784-406e-84e6-432a0abafec5/dns-node-resolver/0.log" Jun 09 11:50:07.693872 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.693830 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" event={"ID":"e5fd153c-0731-4a15-bb20-66cc7ca47f74","Type":"ContainerStarted","Data":"f6674b7a70c7d2124c957148b7c8bff17d8ffb5c702e93c49181727796b73024"} Jun 09 11:50:07.694158 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.694132 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" event={"ID":"e5fd153c-0731-4a15-bb20-66cc7ca47f74","Type":"ContainerStarted","Data":"eea070d5912c4a3a13ee917a30a88e25751d72b12ee26afc782d7e488b4097d7"} Jun 09 11:50:07.694287 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.694167 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:07.709045 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.708991 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" podStartSLOduration=1.708973511 podStartE2EDuration="1.708973511s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:50:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:07.708094767 +0000 UTC m=+404.208949947" watchObservedRunningTime="2026-06-09 11:50:07.708973511 +0000 UTC m=+404.209828699" Jun 09 11:50:07.833909 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:07.833868 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dgcll_3b88fee1-9655-4476-8cd7-c7194a94de17/node-ca/0.log" Jun 09 11:50:08.870345 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:08.870317 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-48qdm_622abbef-221f-479b-bca1-cd2e3e2eff02/serve-healthcheck-canary/0.log" Jun 09 11:50:08.902371 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:08.902338 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:08.953328 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:08.953296 2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4ngqc_b58faefe-c715-469e-b35e-b28c0bba55a7/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:09.275263 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:09.275233 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmpp_592beceb-8920-4fa8-8aa3-c79e1fe7e358/kube-rbac-proxy/0.log" Jun 09 11:50:09.298573 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:09.298542 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmpp_592beceb-8920-4fa8-8aa3-c79e1fe7e358/exporter/0.log" Jun 09 11:50:09.321419 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:09.321395 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-bxmpp_592beceb-8920-4fa8-8aa3-c79e1fe7e358/extractor/0.log" Jun 09 11:50:13.710150 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:13.709187 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hlh4n/perf-node-gather-daemonset-hp42s" Jun 09 11:50:13.752313 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:13.752282 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wz7t7_18c0d2c7-8ec5-4b50-a168-07e24ea02234/kube-storage-version-migrator-operator/1.log" Jun 09 11:50:13.753069 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:13.753049 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-wz7t7_18c0d2c7-8ec5-4b50-a168-07e24ea02234/kube-storage-version-migrator-operator/0.log" Jun 09 11:50:14.876732 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:14.876690 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/kube-multus-additional-cni-plugins/0.log" Jun 09 11:50:14.907039 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:14.906991 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/egress-router-binary-copy/0.log" Jun 09 11:50:14.935467 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:14.935439 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/cni-plugins/0.log" Jun 09 11:50:14.961874 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:14.961794 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/bond-cni-plugin/0.log" Jun 09 11:50:14.987276 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:14.987249 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/routeoverride-cni/0.log" Jun 09 11:50:15.011791 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:15.011734 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/whereabouts-cni-bincopy/0.log" Jun 09 11:50:15.038002 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:15.037968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-hp6nb_0ba521a2-5fb9-495f-935c-d75743fa027b/whereabouts-cni/0.log" Jun 09 11:50:15.242040 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:15.242007 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-ftbrt_f6b58977-15ff-4a8d-b9c0-01eff0e7abec/kube-multus/0.log" Jun 09 11:50:15.294632 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:15.294601 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qzc6_45100e9a-1edb-470f-80e8-610e52b80030/network-metrics-daemon/0.log" Jun 09 11:50:15.320165 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:15.320137 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-6qzc6_45100e9a-1edb-470f-80e8-610e52b80030/kube-rbac-proxy/0.log" Jun 09 11:50:16.732734 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.732698 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-controller/0.log" Jun 09 11:50:16.756243 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.756203 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/1.log" Jun 09 11:50:16.756412 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.756213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovn-acl-logging/0.log" Jun 09 11:50:16.777739 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.777710 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/kube-rbac-proxy-node/0.log" Jun 09 11:50:16.802592 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.802560 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 11:50:16.821608 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.821575 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/northd/0.log" Jun 09 11:50:16.847664 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.847638 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/nbdb/0.log" Jun 09 11:50:16.877382 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.877355 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/sbdb/0.log" Jun 09 11:50:16.923880 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:16.923831 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-b5vvx_5a97a376-eef8-4e9f-8c9f-6ed9ec7b589c/ovnkube-controller/0.log" Jun 09 11:50:17.971505 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:17.971477 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-rl9fb_04000a5e-6faa-45c3-9333-a2862ce49e1e/check-endpoints/0.log" Jun 09 11:50:17.998414 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:17.998383 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-4c5m9_70594268-f6c1-47b6-b209-4dda25f8d6ab/network-check-target-container/0.log" Jun 09 11:50:18.940667 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:18.940618 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-lb8hm_48ba8a37-bcce-4961-838a-ae6f28ff2742/iptables-alerter/0.log" Jun 09 11:50:19.603596 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:19.603566 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-tq8w4_8457144b-cdcc-4d21-95e4-ade541c13200/tuned/0.log" Jun 09 11:50:22.554474 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:22.554437 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-4jkw2_0146d370-5c45-4d22-a9a5-bdc8799fec63/service-ca-controller/0.log" Jun 09 11:50:22.936969 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:22.936890 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2wfdh_6267a89d-c18d-4c13-b516-22ef9a524023/csi-driver/0.log" Jun 09 11:50:22.960151 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:22.960124 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2wfdh_6267a89d-c18d-4c13-b516-22ef9a524023/csi-node-driver-registrar/0.log" Jun 09 11:50:22.982497 ip-10-0-138-33 kubenswrapper[2562]: I0609 11:50:22.982467 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-2wfdh_6267a89d-c18d-4c13-b516-22ef9a524023/csi-liveness-probe/0.log"