Jun 05 11:39:43.180261 ip-10-0-138-129 systemd[1]: Starting Kubernetes Kubelet... Jun 05 11:39:43.586711 ip-10-0-138-129 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:39:43.586711 ip-10-0-138-129 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 05 11:39:43.586711 ip-10-0-138-129 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:39:43.586711 ip-10-0-138-129 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 05 11:39:43.586711 ip-10-0-138-129 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 05 11:39:43.588413 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.588323 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 05 11:39:43.594843 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594819 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.594843 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594839 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.594843 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594843 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.594843 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594846 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594849 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594852 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594859 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594863 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594866 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594869 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594872 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594875 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594878 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594880 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594883 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594885 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594888 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594890 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594893 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594895 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594898 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594900 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594903 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.594967 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594905 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594909 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594911 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594915 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594917 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594919 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594922 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594925 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594927 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594929 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594934 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594937 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594940 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594944 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594948 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594951 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594954 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594957 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594960 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.595446 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594962 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594965 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594968 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594971 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594973 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594976 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594979 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594982 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594984 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594987 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594989 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594992 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594994 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594997 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.594999 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595002 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595005 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595007 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595010 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595012 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.595923 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595015 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595018 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595020 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595023 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595025 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595028 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595030 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595033 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595036 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595040 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595042 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595045 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595047 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595050 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595052 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595056 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595059 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595061 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595063 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.596418 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595066 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595069 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595071 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595073 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595076 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595078 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595081 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595083 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595086 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595088 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595091 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595093 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595096 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595098 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595101 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595104 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595107 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595110 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595865 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.596889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595872 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595875 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595879 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595882 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595886 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595890 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595894 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595896 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595900 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595903 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595905 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595908 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595911 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595913 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595916 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595919 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595922 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595924 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595927 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595929 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.597421 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595932 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595935 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595937 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595940 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595943 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595946 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595949 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595952 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595955 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595957 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595960 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595962 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595965 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595967 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595970 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595973 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595975 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595978 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595981 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595983 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.597947 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595986 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595988 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595990 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595993 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595995 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.595997 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596000 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596003 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596005 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596008 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596010 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596013 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596015 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596017 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596020 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596023 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596026 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596029 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596031 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596034 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.598429 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596037 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596039 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596042 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596044 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596047 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596049 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596054 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596058 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596060 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596063 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596066 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596069 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596072 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596074 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596076 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596079 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596081 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596084 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596086 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.598945 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596089 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596091 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596093 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596096 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596099 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596101 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596104 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596106 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596109 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596114 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596117 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596120 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596122 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596125 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596128 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596130 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596133 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596135 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596138 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.599420 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596574 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596580 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596583 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596586 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596589 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596592 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596595 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596598 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596601 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596603 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596606 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596608 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596611 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596613 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596616 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596618 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596621 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596624 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596627 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596629 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.599897 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596632 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596634 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596637 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596640 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596642 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596645 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596648 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596650 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596654 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596658 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596660 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596663 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596666 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596669 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596672 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596675 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596679 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596682 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596685 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.600380 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596687 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596689 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596692 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596694 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596697 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596699 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596702 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596704 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596707 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596712 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596715 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596717 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596719 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596722 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596725 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596728 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596730 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596733 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596736 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596738 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.600851 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596741 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596743 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596746 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596748 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596750 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596753 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596756 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596758 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596760 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596763 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596767 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596771 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596774 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596776 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596779 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596782 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596800 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596803 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596806 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596808 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.601339 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596811 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596815 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596817 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596820 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596822 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596824 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596827 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596830 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596833 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596835 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596838 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596840 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596843 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596845 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596848 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596850 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596854 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596857 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596861 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.596864 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.601889 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596941 2566 flags.go:64] FLAG: --address="0.0.0.0" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596948 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596955 2566 flags.go:64] FLAG: --anonymous-auth="true" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596959 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596964 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596967 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596971 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596976 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596979 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596982 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596986 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596989 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596992 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.596997 2566 flags.go:64] FLAG: --cgroup-root="" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597000 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597003 2566 flags.go:64] FLAG: --client-ca-file="" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597006 2566 flags.go:64] FLAG: --cloud-provider="external" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597010 2566 flags.go:64] FLAG: --cluster-dns="[]" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597015 2566 flags.go:64] FLAG: --cluster-domain="" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597018 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597021 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597024 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597027 2566 flags.go:64] FLAG: --container-log-max-files="5" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597031 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 05 11:39:43.602424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597034 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597037 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597040 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597043 2566 flags.go:64] FLAG: --contention-profiling="false" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597046 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597049 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597052 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597055 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597059 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597062 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597065 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597068 2566 flags.go:64] FLAG: --enable-load-reader="false" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597071 2566 flags.go:64] FLAG: --enable-server="true" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597074 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597078 2566 flags.go:64] FLAG: --event-burst="100" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597081 2566 flags.go:64] FLAG: --event-qps="50" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597084 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597087 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597090 2566 flags.go:64] FLAG: --eviction-hard="" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597093 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597096 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597100 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597103 2566 flags.go:64] FLAG: --eviction-soft="" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597106 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597109 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 05 11:39:43.603020 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597112 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597115 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597118 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597121 2566 flags.go:64] FLAG: --fail-swap-on="true" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597124 2566 flags.go:64] FLAG: --feature-gates="" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597128 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597131 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597134 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597137 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597140 2566 flags.go:64] FLAG: --healthz-port="10248" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597143 2566 flags.go:64] FLAG: --help="false" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597145 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597149 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597152 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597155 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597158 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597161 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597164 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597167 2566 flags.go:64] FLAG: --image-service-endpoint="" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597170 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597172 2566 flags.go:64] FLAG: --kube-api-burst="100" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597176 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597179 2566 flags.go:64] FLAG: --kube-api-qps="50" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597181 2566 flags.go:64] FLAG: --kube-reserved="" Jun 05 11:39:43.603615 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597184 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597187 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597190 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597192 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597197 2566 flags.go:64] FLAG: --lock-file="" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597200 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597202 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597205 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597213 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597216 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597219 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597222 2566 flags.go:64] FLAG: --logging-format="text" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597224 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597228 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597230 2566 flags.go:64] FLAG: --manifest-url="" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597233 2566 flags.go:64] FLAG: --manifest-url-header="" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597238 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597241 2566 flags.go:64] FLAG: --max-open-files="1000000" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597245 2566 flags.go:64] FLAG: --max-pods="110" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597248 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597251 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597254 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597258 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597263 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597268 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 05 11:39:43.604280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597272 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597283 2566 flags.go:64] FLAG: --node-status-max-images="50" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597288 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597292 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597297 2566 flags.go:64] FLAG: --pod-cidr="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597302 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597315 2566 flags.go:64] FLAG: --pod-manifest-path="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597320 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597325 2566 flags.go:64] FLAG: --pods-per-core="0" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597331 2566 flags.go:64] FLAG: --port="10250" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597336 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597344 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e53c797eb202de04" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597349 2566 flags.go:64] FLAG: --qos-reserved="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597354 2566 flags.go:64] FLAG: --read-only-port="10255" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597359 2566 flags.go:64] FLAG: --register-node="true" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597364 2566 flags.go:64] FLAG: --register-with-taints="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597372 2566 flags.go:64] FLAG: --registry-burst="10" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597376 2566 flags.go:64] FLAG: --registry-qps="5" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597381 2566 flags.go:64] FLAG: --reserved-cpus="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597386 2566 flags.go:64] FLAG: --reserved-memory="" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597393 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597398 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597402 2566 flags.go:64] FLAG: --rotate-certificates="false" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597407 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597412 2566 flags.go:64] FLAG: --runonce="false" Jun 05 11:39:43.604926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597417 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597422 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597429 2566 flags.go:64] FLAG: --seccomp-default="false" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597434 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597440 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597445 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597451 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597456 2566 flags.go:64] FLAG: --storage-driver-password="root" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597461 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597465 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597469 2566 flags.go:64] FLAG: --storage-driver-user="root" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597472 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597475 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597479 2566 flags.go:64] FLAG: --system-cgroups="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597483 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597493 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597498 2566 flags.go:64] FLAG: --tls-cert-file="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597501 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597508 2566 flags.go:64] FLAG: --tls-min-version="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597511 2566 flags.go:64] FLAG: --tls-private-key-file="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597514 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597517 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597520 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597524 2566 flags.go:64] FLAG: --v="2" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597528 2566 flags.go:64] FLAG: --version="false" Jun 05 11:39:43.605575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597532 2566 flags.go:64] FLAG: --vmodule="" Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597536 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.597539 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597659 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597663 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597666 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597669 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597672 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597675 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597678 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597681 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597684 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597686 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597689 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597692 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597694 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597697 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597699 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597702 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597704 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.606299 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597706 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597709 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597712 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597714 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597717 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597720 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597723 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597725 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597728 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597731 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597734 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597737 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597739 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597742 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597744 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597747 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597749 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597754 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597757 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.606808 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597760 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597763 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597766 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597768 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597771 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597773 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597776 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597778 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597781 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597800 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597804 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597808 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597811 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597817 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597821 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597824 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597827 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597830 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597834 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597836 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.607291 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597839 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597841 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597844 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597848 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597851 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597854 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597856 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597859 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597861 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597864 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597866 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597870 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597874 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597877 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597880 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597883 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597885 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597888 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597891 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.607781 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597894 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597897 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597900 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597902 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597905 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597908 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597910 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597913 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597916 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597919 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597921 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597925 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597928 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597930 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597933 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597935 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597939 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597941 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597944 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597946 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.608280 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597949 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597952 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597954 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.597957 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.598625 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.605446 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.605463 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.606887 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.606896 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606966 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606971 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606974 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606977 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606980 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606983 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.608778 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606986 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606989 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606991 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606994 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.606997 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607000 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607002 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607005 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607008 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607012 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607016 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607021 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607026 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607030 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607034 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607037 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607039 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607042 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607045 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.609301 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607049 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607053 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607056 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607059 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607063 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607066 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607069 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607072 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607074 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607077 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607080 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607083 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607085 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607087 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607090 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607094 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607098 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607103 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607107 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607111 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607115 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.609834 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607117 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607120 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607122 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607125 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607127 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607130 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607133 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607136 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607138 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607141 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607143 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607146 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607148 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607152 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607156 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607159 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607163 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607167 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607171 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.610390 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607174 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607177 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607182 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607186 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607190 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607213 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607217 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607221 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607224 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607227 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607229 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607232 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607234 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607237 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607239 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607242 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607245 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607247 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607250 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607253 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.610891 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607255 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607258 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607262 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607267 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607271 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607275 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607279 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607282 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607284 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607287 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607291 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607294 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607296 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607299 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.607305 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:39:43.611402 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607440 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607447 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607451 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607454 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607457 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607459 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607462 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607465 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607468 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607471 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607474 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607476 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607479 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607481 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607483 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607486 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607488 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607491 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607493 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607496 2566 feature_gate.go:328] unrecognized feature gate: Example Jun 05 11:39:43.611829 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607498 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607501 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607503 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607506 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607511 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607515 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607520 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607524 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607528 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607531 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607534 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607536 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607539 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607543 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607547 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607551 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607553 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607556 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607558 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607561 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 05 11:39:43.612464 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607564 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607566 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607568 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607571 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607573 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607576 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607579 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607581 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607584 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607586 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607590 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607594 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607598 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607602 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607606 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607610 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607612 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607614 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607617 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jun 05 11:39:43.613349 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607619 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607621 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607625 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607628 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607630 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607633 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607635 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607638 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607642 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607645 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607648 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607651 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607653 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607656 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607659 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607661 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607664 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607666 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607671 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 05 11:39:43.613999 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607677 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607682 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607687 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607691 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607694 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607697 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607700 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607702 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607705 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607708 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607710 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607713 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607715 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607717 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607720 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607723 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607726 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607728 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607731 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607733 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 05 11:39:43.614466 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:43.607736 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.607741 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.607897 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.609894 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.611303 2566 server.go:1019] "Starting client certificate rotation" Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.611428 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.612192 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 05 11:39:43.615180 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.614455 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 11:39:43.625060 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.625029 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 05 11:39:43.636429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.636398 2566 log.go:25] "Validated CRI v1 runtime API" Jun 05 11:39:43.639129 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.639103 2566 log.go:25] "Validated CRI v1 image API" Jun 05 11:39:43.640106 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.640090 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 05 11:39:43.644639 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.644606 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a308844e-6fa6-422e-a165-528379c79b8e:/dev/nvme0n1p4 e130b0df-88dd-46ad-8b2e-b61e8bb7a4bb:/dev/nvme0n1p3] Jun 05 11:39:43.644742 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.644632 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 05 11:39:43.650042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.649901 2566 manager.go:216] Machine: {Timestamp:2026-06-05 11:39:43.648564039 +0000 UTC m=+0.342251810 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096109 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c97d955cde566b00043323025e9b6 SystemUUID:ec2c97d9-55cd-e566-b000-43323025e9b6 BootID:a632ee14-797a-4cc9-9f7d-419b9673776f Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7e:84:01:27:7d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7e:84:01:27:7d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:62:43:5f:a2:f5:1b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 05 11:39:43.650042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.650025 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 05 11:39:43.650252 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.650159 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 05 11:39:43.652302 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.652282 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 11:39:43.653256 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.653223 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 05 11:39:43.653427 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.653264 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-129.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 05 11:39:43.654132 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.654119 2566 topology_manager.go:138] "Creating topology manager with none policy" Jun 05 11:39:43.654185 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.654139 2566 container_manager_linux.go:309] "Creating device plugin manager" Jun 05 11:39:43.654185 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.654152 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 11:39:43.655472 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.655459 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 05 11:39:43.656241 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.656226 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 05 11:39:43.659022 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659003 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 05 11:39:43.659190 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659175 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 05 11:39:43.659256 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659225 2566 kubelet.go:486] "Attempting to sync node with API server" Jun 05 11:39:43.659256 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659242 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 05 11:39:43.659341 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659259 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 05 11:39:43.659341 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659273 2566 kubelet.go:398] "Adding apiserver pod source" Jun 05 11:39:43.659341 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659287 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 05 11:39:43.659720 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659705 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 11:39:43.659720 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.659882 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 05 11:39:43.670504 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.670483 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 05 11:39:43.671888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.671872 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 05 11:39:43.671978 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.671904 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 05 11:39:43.673544 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673517 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 05 11:39:43.673544 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673537 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 05 11:39:43.673544 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673546 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673555 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673567 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673573 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673582 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673588 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673596 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673602 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673625 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 05 11:39:43.673736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.673632 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 05 11:39:43.674287 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.674268 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 05 11:39:43.674375 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.674349 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 05 11:39:43.674415 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.674381 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 05 11:39:43.674415 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.674392 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 05 11:39:43.678065 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.678047 2566 server.go:1268] "Started kubelet" Jun 05 11:39:43.678582 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.678539 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 05 11:39:43.678681 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.678574 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 05 11:39:43.678681 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.678595 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 05 11:39:43.679626 ip-10-0-138-129 systemd[1]: Started Kubernetes Kubelet. Jun 05 11:39:43.680070 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.679711 2566 server.go:310] "Adding debug handlers to kubelet server" Jun 05 11:39:43.684160 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.684124 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 05 11:39:43.684296 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.684164 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-129.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 05 11:39:43.686950 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.686931 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 05 11:39:43.688540 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.688526 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 05 11:39:43.688601 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.688583 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 05 11:39:43.688721 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.688593 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:43.689485 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689457 2566 factory.go:55] Registering systemd factory Jun 05 11:39:43.689485 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689478 2566 factory.go:223] Registration of the systemd container factory successfully Jun 05 11:39:43.689722 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689707 2566 factory.go:153] Registering CRI-O factory Jun 05 11:39:43.689722 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689723 2566 factory.go:223] Registration of the crio container factory successfully Jun 05 11:39:43.689888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689765 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 05 11:39:43.689888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689801 2566 factory.go:103] Registering Raw factory Jun 05 11:39:43.689888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.689813 2566 manager.go:1196] Started watching for new ooms in manager Jun 05 11:39:43.690099 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.690088 2566 manager.go:349] Starting recovery of all containers Jun 05 11:39:43.692461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.692407 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 05 11:39:43.692461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.692425 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 05 11:39:43.692569 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.692540 2566 reconstruct.go:97] "Volume reconstruction finished" Jun 05 11:39:43.692569 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.692547 2566 reconciler.go:29] "Reconciler: start to sync state" Jun 05 11:39:43.692722 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.692668 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 05 11:39:43.694070 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.693139 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c74ff05e12f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.678013743 +0000 UTC m=+0.371701515,LastTimestamp:2026-06-05 11:39:43.678013743 +0000 UTC m=+0.371701515,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.698235 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.698212 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 05 11:39:43.698341 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.698217 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-129.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 05 11:39:43.700894 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.700873 2566 manager.go:354] Recovery completed Jun 05 11:39:43.702481 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.702385 2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 05 11:39:43.706063 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.706049 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.708411 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708392 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.708517 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708430 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.708517 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708445 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.708915 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708902 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 05 11:39:43.708915 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708912 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 05 11:39:43.709018 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708920 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.709018 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.708927 2566 state_mem.go:36] "Initialized new in-memory state store" Jun 05 11:39:43.709639 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.709625 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.709680 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.709651 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.709680 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.709661 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.710010 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.709999 2566 policy_none.go:49] "None policy: Start" Jun 05 11:39:43.710052 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.710015 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 05 11:39:43.710052 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.710025 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 05 11:39:43.710917 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.710906 2566 policy_none.go:47] "Start" Jun 05 11:39:43.710956 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.710885 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c7500d5b9f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-129.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.7084124 +0000 UTC m=+0.402100181,LastTimestamp:2026-06-05 11:39:43.7084124 +0000 UTC m=+0.402100181,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.719497 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.719409 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c7500d61ddb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-129.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.708437979 +0000 UTC m=+0.402125750,LastTimestamp:2026-06-05 11:39:43.708437979 +0000 UTC m=+0.402125750,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.730030 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.729955 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c7500d648ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-129.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.708448974 +0000 UTC m=+0.402136747,LastTimestamp:2026-06-05 11:39:43.708448974 +0000 UTC m=+0.402136747,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.739987 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.739963 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s8vm8" Jun 05 11:39:43.741033 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.740965 2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-129.ec2.internal.18b62c7500d5b9f0\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c7500d5b9f0 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-129.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.7084124 +0000 UTC m=+0.402100181,LastTimestamp:2026-06-05 11:39:43.709639429 +0000 UTC m=+0.403327201,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.749697 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.749671 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-s8vm8" Jun 05 11:39:43.750423 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750336 2566 manager.go:337] "Starting Device Plugin manager" Jun 05 11:39:43.750423 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.750389 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 05 11:39:43.750423 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750404 2566 server.go:87] "Starting device plugin registration server" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750705 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750723 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750867 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750945 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.750952 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.751878 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.751930 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:43.763874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.752014 2566 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-138-129.ec2.internal.18b62c7500d61ddb\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-129.ec2.internal.18b62c7500d61ddb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-129.ec2.internal,UID:ip-10-0-138-129.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-129.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-129.ec2.internal,},FirstTimestamp:2026-06-05 11:39:43.708437979 +0000 UTC m=+0.402125750,LastTimestamp:2026-06-05 11:39:43.709656335 +0000 UTC m=+0.403344106,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-129.ec2.internal,}" Jun 05 11:39:43.766225 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.766193 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 05 11:39:43.767616 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.767594 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 05 11:39:43.767732 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.767673 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 05 11:39:43.767732 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.767696 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jun 05 11:39:43.767871 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.767733 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 05 11:39:43.769597 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.769497 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:43.851147 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.851060 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.852157 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.852128 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.852280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.852175 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.852280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.852190 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.852280 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.852220 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.860711 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.860689 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.860842 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.860716 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-129.ec2.internal\": node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:43.867983 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.867951 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal"] Jun 05 11:39:43.868119 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.868024 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.870036 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.870018 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.870089 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.870055 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.870089 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.870070 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.871100 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871088 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.871295 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871273 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.871361 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871318 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.871892 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871876 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.871964 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871906 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.871964 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871916 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.871964 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871881 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.872073 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871979 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.872073 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.871988 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.873051 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.873038 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.873109 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.873063 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:43.873768 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.873746 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:43.873853 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.873776 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:43.873853 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.873816 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:43.874332 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.874317 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:43.897666 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.897641 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-129.ec2.internal\" not found" node="ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.902227 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.902210 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-129.ec2.internal\" not found" node="ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.974758 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:43.974732 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:43.993701 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.993660 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.993780 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.993725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7faba1a35fa9fcf7fa91ea1a9e9d3a5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-129.ec2.internal\" (UID: \"b7faba1a35fa9fcf7fa91ea1a9e9d3a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:43.993780 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:43.993751 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.074886 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.074838 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.094346 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094318 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7faba1a35fa9fcf7fa91ea1a9e9d3a5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-129.ec2.internal\" (UID: \"b7faba1a35fa9fcf7fa91ea1a9e9d3a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.094412 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094350 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.094412 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.094472 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.094472 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094440 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f3ea3b8ebb0ab943a0baef2475a75eb5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal\" (UID: \"f3ea3b8ebb0ab943a0baef2475a75eb5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.094472 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.094427 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b7faba1a35fa9fcf7fa91ea1a9e9d3a5-config\") pod \"kube-apiserver-proxy-ip-10-0-138-129.ec2.internal\" (UID: \"b7faba1a35fa9fcf7fa91ea1a9e9d3a5\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.175909 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.175774 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.201442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.201415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.205748 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.205732 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:44.276303 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.276262 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.376955 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.376912 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.477588 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.477557 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.552664 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.552633 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:44.577805 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.577759 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.611427 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.611392 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 05 11:39:44.612104 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.611546 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 11:39:44.612104 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.611575 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 05 11:39:44.677881 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.677842 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.752644 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.752608 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-04 11:34:43 +0000 UTC" deadline="2027-12-01 16:35:18.305056432 +0000 UTC" Jun 05 11:39:44.752644 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.752642 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13060h55m33.552417573s" Jun 05 11:39:44.758529 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:44.758500 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7faba1a35fa9fcf7fa91ea1a9e9d3a5.slice/crio-c9c107d2d868c5b2f63028ea1dfaaec542c93d004c91329fef3c5f14a27a91b6 WatchSource:0}: Error finding container c9c107d2d868c5b2f63028ea1dfaaec542c93d004c91329fef3c5f14a27a91b6: Status 404 returned error can't find the container with id c9c107d2d868c5b2f63028ea1dfaaec542c93d004c91329fef3c5f14a27a91b6 Jun 05 11:39:44.758883 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:44.758847 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ea3b8ebb0ab943a0baef2475a75eb5.slice/crio-2564df9633693e56c3897addade8d6c5c3f1e0faa8c4329d6dc0f6ebf427866d WatchSource:0}: Error finding container 2564df9633693e56c3897addade8d6c5c3f1e0faa8c4329d6dc0f6ebf427866d: Status 404 returned error can't find the container with id 2564df9633693e56c3897addade8d6c5c3f1e0faa8c4329d6dc0f6ebf427866d Jun 05 11:39:44.762489 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.762471 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 11:39:44.771211 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.771171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" event={"ID":"f3ea3b8ebb0ab943a0baef2475a75eb5","Type":"ContainerStarted","Data":"2564df9633693e56c3897addade8d6c5c3f1e0faa8c4329d6dc0f6ebf427866d"} Jun 05 11:39:44.772086 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.772063 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" event={"ID":"b7faba1a35fa9fcf7fa91ea1a9e9d3a5","Type":"ContainerStarted","Data":"c9c107d2d868c5b2f63028ea1dfaaec542c93d004c91329fef3c5f14a27a91b6"} Jun 05 11:39:44.776376 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.776360 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 05 11:39:44.777175 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.777156 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientMemory" Jun 05 11:39:44.777246 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.777188 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasNoDiskPressure" Jun 05 11:39:44.777246 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.777199 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeHasSufficientPID" Jun 05 11:39:44.778234 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.778214 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.879326 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.879289 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.979973 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:44.979938 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-129.ec2.internal\" not found" Jun 05 11:39:44.983984 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.983966 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:44.989262 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:44.989243 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" Jun 05 11:39:45.006284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.004762 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 11:39:45.006284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.006226 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" Jun 05 11:39:45.016156 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.016134 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 05 11:39:45.100141 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.100109 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:45.521467 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.521434 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:45.660336 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.660300 2566 apiserver.go:52] "Watching apiserver" Jun 05 11:39:45.668433 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.668407 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 05 11:39:45.669457 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.669433 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-z2p74","openshift-multus/multus-mh2m5","openshift-network-diagnostics/network-check-target-c6g7h","openshift-network-operator/iptables-alerter-8wq78","openshift-ovn-kubernetes/ovnkube-node-rkx2v","kube-system/global-pull-secret-syncer-mctkq","kube-system/konnectivity-agent-l76v8","openshift-dns/node-resolver-8lww9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal","openshift-multus/multus-additional-cni-plugins-9x2fd","openshift-multus/network-metrics-daemon-lls8g","kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx","openshift-cluster-node-tuning-operator/tuned-pmcz6"] Jun 05 11:39:45.670741 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.670716 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.671724 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.671689 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.672852 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.672830 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:45.672961 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.672925 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:45.673466 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.673446 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9f4gj\"" Jun 05 11:39:45.673572 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.673553 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 05 11:39:45.673692 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.673674 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 05 11:39:45.674011 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.673996 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.675294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.674478 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 05 11:39:45.675294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.674489 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.675294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.674821 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-gh52g\"" Jun 05 11:39:45.675294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.674852 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.675294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.675236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.676365 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.676343 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.676464 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.676408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.676464 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.676447 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.676573 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.676466 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:45.676659 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.676644 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-v276n\"" Jun 05 11:39:45.676697 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.676638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 05 11:39:45.677566 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.677548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.679588 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.679569 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.680070 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680042 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.680160 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.680160 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680102 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.680160 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680140 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 05 11:39:45.680398 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680382 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.680460 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680417 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 05 11:39:45.680529 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680512 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 05 11:39:45.680586 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680532 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-fpq2d\"" Jun 05 11:39:45.680997 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.680979 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 05 11:39:45.681143 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.681127 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.681195 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.681168 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9577s\"" Jun 05 11:39:45.681769 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.681525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.681769 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.681767 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.682775 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.682341 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 05 11:39:45.682775 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.682444 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.682775 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.682637 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-jgthq\"" Jun 05 11:39:45.682775 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.682747 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.683032 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.682871 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:45.683827 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.683807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.685317 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.684371 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.685317 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.684762 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 05 11:39:45.685317 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.684989 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rnrsr\"" Jun 05 11:39:45.685317 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.685209 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 05 11:39:45.685550 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.685512 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.685693 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.685676 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 05 11:39:45.685945 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.685715 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 05 11:39:45.686198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.685723 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-875gc\"" Jun 05 11:39:45.686948 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.686927 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 05 11:39:45.687835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.687815 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xs564\"" Jun 05 11:39:45.687938 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.687890 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 05 11:39:45.690120 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.689582 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 05 11:39:45.694123 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.694105 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 05 11:39:45.702207 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.702180 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 05 11:39:45.704063 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704032 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-systemd-units\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704146 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704075 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-bin\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704146 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704099 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrjbn\" (UniqueName: \"kubernetes.io/projected/942f21a4-4334-4203-be51-0f47efa7d7ae-kube-api-access-jrjbn\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.704146 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704128 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-k8s-cni-cncf-io\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704287 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-kubelet\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704287 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704177 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7shg\" (UniqueName: \"kubernetes.io/projected/46978300-0946-4115-a291-80cefa8118f7-kube-api-access-m7shg\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704287 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704201 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.704287 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704223 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.704287 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704267 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-systemd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704290 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1a891d7-0d9d-469a-a558-5593b221f471-hosts-file\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b76b44dc-1800-47da-aea9-15676a1c27b6-iptables-alerter-script\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704344 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-bin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-registration-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704397 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-log-socket\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704423 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704449 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf2g5\" (UniqueName: \"kubernetes.io/projected/b1a891d7-0d9d-469a-a558-5593b221f471-kube-api-access-kf2g5\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpzvs\" (UniqueName: \"kubernetes.io/projected/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-kube-api-access-zpzvs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704539 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-socket-dir-parent\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-conf-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704633 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cnibin\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704661 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-conf\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704678 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-etc-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704703 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-ovn\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.704730 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-node-log\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/942f21a4-4334-4203-be51-0f47efa7d7ae-serviceca\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704819 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrjtz\" (UniqueName: \"kubernetes.io/projected/b76b44dc-1800-47da-aea9-15676a1c27b6-kube-api-access-hrjtz\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704864 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-systemd\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-env-overrides\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704946 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-kubelet-config\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.704995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-etc-kubernetes\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705052 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-os-release\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.705112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705120 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-slash\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705180 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-script-lib\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705203 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/942f21a4-4334-4203-be51-0f47efa7d7ae-host\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a891d7-0d9d-469a-a558-5593b221f471-tmp-dir\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705269 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b76b44dc-1800-47da-aea9-15676a1c27b6-host-slash\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705292 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tp2v\" (UniqueName: \"kubernetes.io/projected/b157d1ff-fd36-4f19-8f47-5122f2a154ba-kube-api-access-8tp2v\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705335 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-var-lib-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705349 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-config\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705367 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.705386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705389 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysconfig\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705408 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-sys\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705428 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-lib-modules\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705451 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-os-release\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705469 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-multus\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-dbus\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705506 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-var-lib-kubelet\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705521 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-multus-daemon-config\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705535 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efd2cbbf-b8cd-46c2-865a-59d642a4113b-konnectivity-ca\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705549 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-socket-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705564 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-device-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-tuned\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-cnibin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705619 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705646 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705670 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kpwv\" (UniqueName: \"kubernetes.io/projected/9df92fe6-ac1e-40af-8a62-d9951836caf0-kube-api-access-8kpwv\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705693 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-multus-certs\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.705818 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-kubelet\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-host\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705745 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-system-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-netns\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-system-cni-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705811 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-sys-fs\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705842 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kwxp\" (UniqueName: \"kubernetes.io/projected/c82695ff-4958-41f9-8252-c852506a84b7-kube-api-access-9kwxp\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705863 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705879 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-netd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705893 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-run\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705910 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-tmp\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705925 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705940 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705960 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-modprobe-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.705982 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-kubernetes\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706020 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.706370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706035 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-cni-binary-copy\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.707014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706050 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efd2cbbf-b8cd-46c2-865a-59d642a4113b-agent-certs\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.707014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706066 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.707014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706080 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-netns\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.707014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jrzt\" (UniqueName: \"kubernetes.io/projected/688a6069-01fd-44e7-99f7-04174fc1d4b8-kube-api-access-7jrzt\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.707014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.706114 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-hostroot\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.807445 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-socket-dir-parent\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.807445 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807378 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-conf-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.807445 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807396 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cnibin\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.807445 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807412 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-conf\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.807445 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807436 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-socket-dir-parent\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.807819 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807456 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-conf-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.807963 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807478 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cnibin\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.808034 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-etc-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808094 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808043 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-ovn\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808094 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.807806 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-conf\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.808187 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808120 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-etc-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808187 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808129 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-ovn\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808187 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808168 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-node-log\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808335 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808209 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/942f21a4-4334-4203-be51-0f47efa7d7ae-serviceca\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.808335 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808239 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrjtz\" (UniqueName: \"kubernetes.io/projected/b76b44dc-1800-47da-aea9-15676a1c27b6-kube-api-access-hrjtz\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.808335 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808249 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-node-log\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808335 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-systemd\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.808335 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-env-overrides\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808339 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-kubelet-config\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-etc-kubernetes\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-os-release\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808436 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808483 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-slash\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-script-lib\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808665 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808715 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-slash\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808734 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-kubelet-config\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808767 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-etc-kubernetes\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-etc-selinux\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808853 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/942f21a4-4334-4203-be51-0f47efa7d7ae-serviceca\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.808910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/942f21a4-4334-4203-be51-0f47efa7d7ae-host\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808865 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-systemd\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808938 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/942f21a4-4334-4203-be51-0f47efa7d7ae-host\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808924 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a891d7-0d9d-469a-a558-5593b221f471-tmp-dir\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.808993 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b76b44dc-1800-47da-aea9-15676a1c27b6-host-slash\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809029 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-env-overrides\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809063 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tp2v\" (UniqueName: \"kubernetes.io/projected/b157d1ff-fd36-4f19-8f47-5122f2a154ba-kube-api-access-8tp2v\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-var-lib-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809130 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-config\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809165 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809202 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b1a891d7-0d9d-469a-a558-5593b221f471-tmp-dir\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.809238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809103 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b76b44dc-1800-47da-aea9-15676a1c27b6-host-slash\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809273 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysctl-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809197 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysconfig\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809330 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-var-lib-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-sys\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809393 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-os-release\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809419 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-script-lib\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809400 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-lib-modules\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-os-release\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809481 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-lib-modules\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-multus\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.809535 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809545 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-sys\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809556 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-sysconfig\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809546 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-multus\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809592 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-dbus\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809595 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-os-release\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.809835 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.809620 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:39:46.30959778 +0000 UTC m=+3.003285562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-var-lib-kubelet\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809702 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-multus-daemon-config\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809733 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efd2cbbf-b8cd-46c2-865a-59d642a4113b-konnectivity-ca\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-dbus\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-socket-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809765 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-var-lib-kubelet\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809817 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-device-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-tuned\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-cnibin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809895 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-socket-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809905 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809957 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kpwv\" (UniqueName: \"kubernetes.io/projected/9df92fe6-ac1e-40af-8a62-d9951836caf0-kube-api-access-8kpwv\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.809984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-multus-certs\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810010 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-kubelet\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810036 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-host\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.810709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810061 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-system-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810068 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-netns\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-cnibin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810195 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-netns\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810196 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-multus-certs\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-kubelet\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810008 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovnkube-config\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810265 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-openvswitch\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810312 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-system-cni-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810324 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/efd2cbbf-b8cd-46c2-865a-59d642a4113b-konnectivity-ca\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810331 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810341 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-sys-fs\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810382 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-system-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kwxp\" (UniqueName: \"kubernetes.io/projected/c82695ff-4958-41f9-8252-c852506a84b7-kube-api-access-9kwxp\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810394 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-sys-fs\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810401 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-multus-daemon-config\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810330 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-host\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.811521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810446 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b157d1ff-fd36-4f19-8f47-5122f2a154ba-system-cni-dir\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810563 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-device-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810672 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-netd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810743 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-run\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810812 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-run\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810889 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-netd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810937 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-tmp\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.810980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811020 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811055 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-modprobe-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811085 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-kubernetes\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811153 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-cni-binary-copy\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efd2cbbf-b8cd-46c2-865a-59d642a4113b-agent-certs\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-netns\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.812499 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811274 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jrzt\" (UniqueName: \"kubernetes.io/projected/688a6069-01fd-44e7-99f7-04174fc1d4b8-kube-api-access-7jrzt\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811305 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-hostroot\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811336 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-systemd-units\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-bin\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811394 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrjbn\" (UniqueName: \"kubernetes.io/projected/942f21a4-4334-4203-be51-0f47efa7d7ae-kube-api-access-jrjbn\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811429 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-k8s-cni-cncf-io\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811462 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-kubelet\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7shg\" (UniqueName: \"kubernetes.io/projected/46978300-0946-4115-a291-80cefa8118f7-kube-api-access-m7shg\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811525 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-binary-copy\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811576 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-systemd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811612 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-cni-bin\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811670 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-run-netns\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.811702 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-modprobe-d\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812171 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812220 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/46978300-0946-4115-a291-80cefa8118f7-cni-binary-copy\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813230 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812292 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-kubernetes\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812351 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-multus-cni-dir\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1a891d7-0d9d-469a-a558-5593b221f471-hosts-file\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812403 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-run-k8s-cni-cncf-io\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812419 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b76b44dc-1800-47da-aea9-15676a1c27b6-iptables-alerter-script\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812449 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-bin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812469 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-run-systemd\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812473 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-registration-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-log-socket\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812530 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812562 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf2g5\" (UniqueName: \"kubernetes.io/projected/b1a891d7-0d9d-469a-a558-5593b221f471-kube-api-access-kf2g5\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812564 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-kubelet-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812589 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpzvs\" (UniqueName: \"kubernetes.io/projected/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-kube-api-access-zpzvs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812624 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-kubelet\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812669 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-hostroot\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.812744 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:45.813960 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.812822 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:39:46.312783162 +0000 UTC m=+3.006470937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.812974 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-log-socket\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.813042 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b1a891d7-0d9d-469a-a558-5593b221f471-hosts-file\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.813065 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.813590 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b76b44dc-1800-47da-aea9-15676a1c27b6-iptables-alerter-script\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.813862 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c82695ff-4958-41f9-8252-c852506a84b7-registration-dir\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.813963 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/46978300-0946-4115-a291-80cefa8118f7-host-var-lib-cni-bin\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.814025 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9df92fe6-ac1e-40af-8a62-d9951836caf0-systemd-units\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.814074 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-tmp\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.814494 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b157d1ff-fd36-4f19-8f47-5122f2a154ba-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.814838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.814588 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/efd2cbbf-b8cd-46c2-865a-59d642a4113b-agent-certs\") pod \"konnectivity-agent-l76v8\" (UID: \"efd2cbbf-b8cd-46c2-865a-59d642a4113b\") " pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.816441 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.816415 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:39:45.816441 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.816445 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:39:45.816611 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.816461 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:45.816611 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:45.816524 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:39:46.316511514 +0000 UTC m=+3.010199273 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:45.816857 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.816724 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9df92fe6-ac1e-40af-8a62-d9951836caf0-ovn-node-metrics-cert\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.817129 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.817108 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrjtz\" (UniqueName: \"kubernetes.io/projected/b76b44dc-1800-47da-aea9-15676a1c27b6-kube-api-access-hrjtz\") pod \"iptables-alerter-8wq78\" (UID: \"b76b44dc-1800-47da-aea9-15676a1c27b6\") " pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:45.818774 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.818747 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tp2v\" (UniqueName: \"kubernetes.io/projected/b157d1ff-fd36-4f19-8f47-5122f2a154ba-kube-api-access-8tp2v\") pod \"multus-additional-cni-plugins-9x2fd\" (UID: \"b157d1ff-fd36-4f19-8f47-5122f2a154ba\") " pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:45.819540 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.819514 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kwxp\" (UniqueName: \"kubernetes.io/projected/c82695ff-4958-41f9-8252-c852506a84b7-kube-api-access-9kwxp\") pod \"aws-ebs-csi-driver-node-p6ggx\" (UID: \"c82695ff-4958-41f9-8252-c852506a84b7\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:45.819625 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.819565 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/688a6069-01fd-44e7-99f7-04174fc1d4b8-etc-tuned\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.819812 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.819772 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kpwv\" (UniqueName: \"kubernetes.io/projected/9df92fe6-ac1e-40af-8a62-d9951836caf0-kube-api-access-8kpwv\") pod \"ovnkube-node-rkx2v\" (UID: \"9df92fe6-ac1e-40af-8a62-d9951836caf0\") " pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:45.824085 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.824040 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrjbn\" (UniqueName: \"kubernetes.io/projected/942f21a4-4334-4203-be51-0f47efa7d7ae-kube-api-access-jrjbn\") pod \"node-ca-z2p74\" (UID: \"942f21a4-4334-4203-be51-0f47efa7d7ae\") " pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:45.825340 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.825313 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf2g5\" (UniqueName: \"kubernetes.io/projected/b1a891d7-0d9d-469a-a558-5593b221f471-kube-api-access-kf2g5\") pod \"node-resolver-8lww9\" (UID: \"b1a891d7-0d9d-469a-a558-5593b221f471\") " pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:45.825459 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.825376 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jrzt\" (UniqueName: \"kubernetes.io/projected/688a6069-01fd-44e7-99f7-04174fc1d4b8-kube-api-access-7jrzt\") pod \"tuned-pmcz6\" (UID: \"688a6069-01fd-44e7-99f7-04174fc1d4b8\") " pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:45.826381 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.826362 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpzvs\" (UniqueName: \"kubernetes.io/projected/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-kube-api-access-zpzvs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:45.826468 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.826413 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7shg\" (UniqueName: \"kubernetes.io/projected/46978300-0946-4115-a291-80cefa8118f7-kube-api-access-m7shg\") pod \"multus-mh2m5\" (UID: \"46978300-0946-4115-a291-80cefa8118f7\") " pod="openshift-multus/multus-mh2m5" Jun 05 11:39:45.983217 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.983168 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:39:45.992284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:45.992255 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" Jun 05 11:39:46.002026 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.001999 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8wq78" Jun 05 11:39:46.009729 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.009700 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:39:46.016667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.016646 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" Jun 05 11:39:46.021833 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.021780 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2xst" Jun 05 11:39:46.022845 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.022823 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-z2p74" Jun 05 11:39:46.029478 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.029455 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh2m5" Jun 05 11:39:46.035959 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.035939 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" Jun 05 11:39:46.041633 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.041608 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-8lww9" Jun 05 11:39:46.044636 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.044617 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d2xst" Jun 05 11:39:46.316433 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.316397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:46.316590 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.316458 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:46.316590 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.316558 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:46.316680 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.316616 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:39:47.316600383 +0000 UTC m=+4.010288141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:46.316680 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.316562 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:46.316680 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.316679 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:39:47.316665633 +0000 UTC m=+4.010353407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:46.417863 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.417825 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:46.418036 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.418005 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:39:46.418036 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.418028 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:39:46.418116 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.418042 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:46.418116 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.418102 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:39:47.41808745 +0000 UTC m=+4.111775230 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:46.606172 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.606142 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod688a6069_01fd_44e7_99f7_04174fc1d4b8.slice/crio-d6e3906dd46ef1936ee415727552aabbf87f5c7dfcb4def032e57808252b931b WatchSource:0}: Error finding container d6e3906dd46ef1936ee415727552aabbf87f5c7dfcb4def032e57808252b931b: Status 404 returned error can't find the container with id d6e3906dd46ef1936ee415727552aabbf87f5c7dfcb4def032e57808252b931b Jun 05 11:39:46.607205 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.606935 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76b44dc_1800_47da_aea9_15676a1c27b6.slice/crio-290e7adfe1eacdfbc38bad866dcbefa4a6c8bfe48d6c1a536a4a8a591229e861 WatchSource:0}: Error finding container 290e7adfe1eacdfbc38bad866dcbefa4a6c8bfe48d6c1a536a4a8a591229e861: Status 404 returned error can't find the container with id 290e7adfe1eacdfbc38bad866dcbefa4a6c8bfe48d6c1a536a4a8a591229e861 Jun 05 11:39:46.608455 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.608426 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a891d7_0d9d_469a_a558_5593b221f471.slice/crio-2bab1e201f954a949e988b4006dc12b2cdb725997780b1d83a856c99ba5ddd4f WatchSource:0}: Error finding container 2bab1e201f954a949e988b4006dc12b2cdb725997780b1d83a856c99ba5ddd4f: Status 404 returned error can't find the container with id 2bab1e201f954a949e988b4006dc12b2cdb725997780b1d83a856c99ba5ddd4f Jun 05 11:39:46.613136 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.613111 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82695ff_4958_41f9_8252_c852506a84b7.slice/crio-4c95ab6c7b0264526d3150787821ab6a52707ce093b38a54f3a39f919f73ae99 WatchSource:0}: Error finding container 4c95ab6c7b0264526d3150787821ab6a52707ce093b38a54f3a39f919f73ae99: Status 404 returned error can't find the container with id 4c95ab6c7b0264526d3150787821ab6a52707ce093b38a54f3a39f919f73ae99 Jun 05 11:39:46.615124 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.615098 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefd2cbbf_b8cd_46c2_865a_59d642a4113b.slice/crio-176c435f8167015067a3a6c41878f90b964a58cbf9dd325c31079978b4d33ded WatchSource:0}: Error finding container 176c435f8167015067a3a6c41878f90b964a58cbf9dd325c31079978b4d33ded: Status 404 returned error can't find the container with id 176c435f8167015067a3a6c41878f90b964a58cbf9dd325c31079978b4d33ded Jun 05 11:39:46.616593 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.616550 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df92fe6_ac1e_40af_8a62_d9951836caf0.slice/crio-09af4ce18d84ef47b74d03c2f2d5d5d1e1870fb4bdc942ba5b3d0de67646d22c WatchSource:0}: Error finding container 09af4ce18d84ef47b74d03c2f2d5d5d1e1870fb4bdc942ba5b3d0de67646d22c: Status 404 returned error can't find the container with id 09af4ce18d84ef47b74d03c2f2d5d5d1e1870fb4bdc942ba5b3d0de67646d22c Jun 05 11:39:46.618362 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.618302 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46978300_0946_4115_a291_80cefa8118f7.slice/crio-c4dae2b902ef92cf1d1954b046dc55db02febd9afde7d45eee6e832410f7dc92 WatchSource:0}: Error finding container c4dae2b902ef92cf1d1954b046dc55db02febd9afde7d45eee6e832410f7dc92: Status 404 returned error can't find the container with id c4dae2b902ef92cf1d1954b046dc55db02febd9afde7d45eee6e832410f7dc92 Jun 05 11:39:46.620547 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:39:46.620529 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod942f21a4_4334_4203_be51_0f47efa7d7ae.slice/crio-7cb3ef0468eb29712c439f7e2ece1d9aefb387b6014d6617c6891f420f2ebde3 WatchSource:0}: Error finding container 7cb3ef0468eb29712c439f7e2ece1d9aefb387b6014d6617c6891f420f2ebde3: Status 404 returned error can't find the container with id 7cb3ef0468eb29712c439f7e2ece1d9aefb387b6014d6617c6891f420f2ebde3 Jun 05 11:39:46.768749 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.768720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:46.769158 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:46.768856 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:46.777353 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.777315 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" event={"ID":"b7faba1a35fa9fcf7fa91ea1a9e9d3a5","Type":"ContainerStarted","Data":"1b30410e9abe86df8a9453dc524040181e1b67e45b61ba286f60c93d92ad3a64"} Jun 05 11:39:46.781598 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.781570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerStarted","Data":"d3869114a733d2d1a7d5702130f55dce7cbedd7c5fd292dd1912fcb62919ad38"} Jun 05 11:39:46.782778 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.782746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2p74" event={"ID":"942f21a4-4334-4203-be51-0f47efa7d7ae","Type":"ContainerStarted","Data":"7cb3ef0468eb29712c439f7e2ece1d9aefb387b6014d6617c6891f420f2ebde3"} Jun 05 11:39:46.783768 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.783746 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh2m5" event={"ID":"46978300-0946-4115-a291-80cefa8118f7","Type":"ContainerStarted","Data":"c4dae2b902ef92cf1d1954b046dc55db02febd9afde7d45eee6e832410f7dc92"} Jun 05 11:39:46.784705 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.784684 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" event={"ID":"c82695ff-4958-41f9-8252-c852506a84b7","Type":"ContainerStarted","Data":"4c95ab6c7b0264526d3150787821ab6a52707ce093b38a54f3a39f919f73ae99"} Jun 05 11:39:46.786453 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.786429 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wq78" event={"ID":"b76b44dc-1800-47da-aea9-15676a1c27b6","Type":"ContainerStarted","Data":"290e7adfe1eacdfbc38bad866dcbefa4a6c8bfe48d6c1a536a4a8a591229e861"} Jun 05 11:39:46.789509 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.789485 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" event={"ID":"688a6069-01fd-44e7-99f7-04174fc1d4b8","Type":"ContainerStarted","Data":"d6e3906dd46ef1936ee415727552aabbf87f5c7dfcb4def032e57808252b931b"} Jun 05 11:39:46.790692 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.790669 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"09af4ce18d84ef47b74d03c2f2d5d5d1e1870fb4bdc942ba5b3d0de67646d22c"} Jun 05 11:39:46.791237 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.791194 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-129.ec2.internal" podStartSLOduration=1.791180987 podStartE2EDuration="1.791180987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:39:46.790938395 +0000 UTC m=+3.484626177" watchObservedRunningTime="2026-06-05 11:39:46.791180987 +0000 UTC m=+3.484868767" Jun 05 11:39:46.791837 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.791814 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l76v8" event={"ID":"efd2cbbf-b8cd-46c2-865a-59d642a4113b","Type":"ContainerStarted","Data":"176c435f8167015067a3a6c41878f90b964a58cbf9dd325c31079978b4d33ded"} Jun 05 11:39:46.794149 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:46.794128 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lww9" event={"ID":"b1a891d7-0d9d-469a-a558-5593b221f471","Type":"ContainerStarted","Data":"2bab1e201f954a949e988b4006dc12b2cdb725997780b1d83a856c99ba5ddd4f"} Jun 05 11:39:47.047770 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.047721 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 11:34:46 +0000 UTC" deadline="2027-11-21 08:35:51.911017548 +0000 UTC" Jun 05 11:39:47.047770 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.047768 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12812h56m4.863254152s" Jun 05 11:39:47.324923 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.324878 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:47.325131 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.324947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:47.325131 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.325074 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:47.325242 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.325133 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:39:49.32511527 +0000 UTC m=+6.018803047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:47.325570 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.325548 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:47.325675 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.325608 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:39:49.32559089 +0000 UTC m=+6.019278655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:47.426380 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.426338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:47.426553 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.426517 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:39:47.426553 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.426539 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:39:47.426553 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.426552 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:47.426725 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.426610 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:39:49.426589926 +0000 UTC m=+6.120277702 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:47.770563 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.770526 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:47.771037 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.770663 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:47.771113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.771083 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:47.771206 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:47.771183 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:47.774111 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.774086 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 05 11:39:47.812819 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.812532 2566 generic.go:356] "Generic (PLEG): container finished" podID="f3ea3b8ebb0ab943a0baef2475a75eb5" containerID="4e82b403b71729fe3e7aed1876ade2578b469a33e5b4eeb0f6be7d84d73eee59" exitCode=0 Jun 05 11:39:47.812819 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:47.812636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" event={"ID":"f3ea3b8ebb0ab943a0baef2475a75eb5","Type":"ContainerDied","Data":"4e82b403b71729fe3e7aed1876ade2578b469a33e5b4eeb0f6be7d84d73eee59"} Jun 05 11:39:48.048858 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:48.048819 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-04 11:34:46 +0000 UTC" deadline="2027-12-22 00:52:35.920945143 +0000 UTC" Jun 05 11:39:48.048858 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:48.048853 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13549h12m47.872095699s" Jun 05 11:39:48.768961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:48.768928 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:48.769157 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:48.769063 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:48.826974 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:48.826936 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" event={"ID":"f3ea3b8ebb0ab943a0baef2475a75eb5","Type":"ContainerStarted","Data":"ab40984cc8d4b801e97c1125f435c91ea0269a65a62bc02703d34a382735207d"} Jun 05 11:39:48.846889 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:48.846819 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-129.ec2.internal" podStartSLOduration=4.846779549 podStartE2EDuration="4.846779549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:39:48.846229162 +0000 UTC m=+5.539916944" watchObservedRunningTime="2026-06-05 11:39:48.846779549 +0000 UTC m=+5.540467331" Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:49.342634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:49.342709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.342857 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.342919 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:39:53.342901244 +0000 UTC m=+10.036589024 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.343305 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:49.343394 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.343357 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:39:53.343342974 +0000 UTC m=+10.037030738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:49.443255 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:49.443196 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:49.443456 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.443428 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:39:49.443456 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.443452 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:39:49.443598 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.443464 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:49.443598 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.443527 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:39:53.443508434 +0000 UTC m=+10.137196195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:49.770658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:49.768925 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:49.770658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:49.768977 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:49.770658 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.769059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:49.770658 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:49.769191 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:50.767986 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:50.767944 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:50.768477 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:50.768094 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:51.770413 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:51.769908 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:51.770413 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:51.770055 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:51.770955 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:51.770531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:51.770955 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:51.770638 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:52.768881 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:52.768843 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:52.769124 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:52.768983 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:53.379841 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:53.379776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:53.380371 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:53.379884 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:53.380371 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.379964 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:53.380371 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.379987 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:53.380371 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.380032 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:01.380018101 +0000 UTC m=+18.073705860 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:39:53.380371 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.380045 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:40:01.380038623 +0000 UTC m=+18.073726381 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:39:53.480512 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:53.480468 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:53.480746 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.480723 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:39:53.480866 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.480770 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:39:53.480866 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.480816 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:53.480965 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.480881 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:40:01.480861939 +0000 UTC m=+18.174549698 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:39:53.769181 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:53.769145 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:53.769356 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.769243 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:53.769356 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:53.769330 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:53.769563 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:53.769508 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:54.768427 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:54.768383 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:54.768922 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:54.768518 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:55.770587 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:55.769928 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:55.770587 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:55.770082 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:55.770587 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:55.770415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:55.770587 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:55.770524 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:56.768836 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:56.768805 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:56.769005 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:56.768912 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:57.768535 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:57.768494 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:57.769012 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:57.768641 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:57.769012 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:57.768653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:57.769012 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:57.768772 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:39:58.767967 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:58.767924 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:39:58.768143 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:58.768077 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:39:59.768562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:59.768519 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:39:59.768562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:39:59.768565 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:39:59.769092 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:59.768666 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:39:59.769092 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:39:59.768824 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:00.768998 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:00.768951 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:00.769433 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:00.769087 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:01.441197 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:01.441162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:01.441400 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:01.441237 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:01.441400 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.441317 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:01.441400 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.441322 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:01.441400 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.441383 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:40:17.441364845 +0000 UTC m=+34.135052605 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:01.441400 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.441399 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:17.441390462 +0000 UTC m=+34.135078220 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:01.541688 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:01.541651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:01.541874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.541823 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:40:01.541874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.541842 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:40:01.541874 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.541854 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:01.542044 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.541922 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:40:17.541902794 +0000 UTC m=+34.235590571 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:01.768439 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:01.768388 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:01.768439 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:01.768415 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:01.768680 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.768532 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:01.768680 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:01.768612 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:02.768425 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:02.768215 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:02.768883 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:02.768523 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:03.768705 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:03.768667 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:03.769162 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:03.768806 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:03.769162 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:03.768819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:03.769162 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:03.768913 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:04.768552 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:04.768509 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:04.768721 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:04.768622 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:05.768670 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:05.768637 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:05.768670 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:05.768653 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:05.769089 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:05.768744 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:05.769089 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:05.768827 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:06.768696 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.768661 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:06.768891 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:06.768810 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:06.869141 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.869052 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="167d8836a8da3bf07a035b9e1189abd6facd2f1c4d45ef57f8cacc7464ab820b" exitCode=0 Jun 05 11:40:06.869292 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.869147 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"167d8836a8da3bf07a035b9e1189abd6facd2f1c4d45ef57f8cacc7464ab820b"} Jun 05 11:40:06.870954 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.870924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-z2p74" event={"ID":"942f21a4-4334-4203-be51-0f47efa7d7ae","Type":"ContainerStarted","Data":"44de581076974100cfb6225927322dc912d5fb699ecd26ae7440ab3553d9996b"} Jun 05 11:40:06.872663 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.872641 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh2m5" event={"ID":"46978300-0946-4115-a291-80cefa8118f7","Type":"ContainerStarted","Data":"2152fdc5124b7015598960535749c64a8987bd1462b02c7befdb6542ab8468c0"} Jun 05 11:40:06.874173 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.874144 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" event={"ID":"c82695ff-4958-41f9-8252-c852506a84b7","Type":"ContainerStarted","Data":"fa4757ee6d7d8c4c82d03b03c410d88edf5f0b1762d0a394f38a15b101bab3c3"} Jun 05 11:40:06.876737 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.876711 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" event={"ID":"688a6069-01fd-44e7-99f7-04174fc1d4b8","Type":"ContainerStarted","Data":"c5bce40469a03820916c967f541209f15c531ec4474eab2237d5675a2b255bf0"} Jun 05 11:40:06.880301 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880283 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:40:06.880644 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880613 2566 generic.go:356] "Generic (PLEG): container finished" podID="9df92fe6-ac1e-40af-8a62-d9951836caf0" containerID="015b3ebfa53576d47110ca4cb572dc6cfd7c56d8a5c1dde8788cc91a40424645" exitCode=1 Jun 05 11:40:06.880731 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880654 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"e935d4c0d34cc2b4193e60afe3866799ad62b807cdf8abf71baa676e56c7cdc8"} Jun 05 11:40:06.880781 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880736 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"ca4a93df220e611f36bd40021cf8a35a99ff1b85b3fb36102e3ae9d0c1857e54"} Jun 05 11:40:06.880847 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"295250119b5eabbf58e436fe9a52aa032c3d82731e50ad130ac92f7b79166cc9"} Jun 05 11:40:06.880880 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"f6019c004ced4eb6da718b927b49e4bab3746b50dc64c2501669d6fc1f1e051f"} Jun 05 11:40:06.880921 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880893 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerDied","Data":"015b3ebfa53576d47110ca4cb572dc6cfd7c56d8a5c1dde8788cc91a40424645"} Jun 05 11:40:06.880957 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.880930 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"57346adfb54e6c68a6c6cc1012ddf5ff1fb679465793fcc494bdcd6277d4905c"} Jun 05 11:40:06.882118 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.882094 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l76v8" event={"ID":"efd2cbbf-b8cd-46c2-865a-59d642a4113b","Type":"ContainerStarted","Data":"d0203ec442cc0a6f88a444e53535bcfd0502f9b8e1c59b74a084d7296304ca7c"} Jun 05 11:40:06.886162 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.886137 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-8lww9" event={"ID":"b1a891d7-0d9d-469a-a558-5593b221f471","Type":"ContainerStarted","Data":"b177a21638fa29bcba026100a52157ae0aa284b2ceb3aa74eb729f1b49bc613b"} Jun 05 11:40:06.910565 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.910518 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mh2m5" podStartSLOduration=4.566428585 podStartE2EDuration="23.910503549s" totalImagesPullingTime="19.344074964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:06.910366122 +0000 UTC m=+23.604053904" watchObservedRunningTime="2026-06-05 11:40:06.910503549 +0000 UTC m=+23.604191331" Jun 05 11:40:06.925472 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.925418 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l76v8" podStartSLOduration=13.72454097 podStartE2EDuration="23.925400404s" totalImagesPullingTime="10.200859434s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:06.924870731 +0000 UTC m=+23.618558512" watchObservedRunningTime="2026-06-05 11:40:06.925400404 +0000 UTC m=+23.619088187" Jun 05 11:40:06.940330 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.940276 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-8lww9" podStartSLOduration=4.61088773 podStartE2EDuration="23.940261295s" totalImagesPullingTime="19.329373565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:06.939863395 +0000 UTC m=+23.633551177" watchObservedRunningTime="2026-06-05 11:40:06.940261295 +0000 UTC m=+23.633949075" Jun 05 11:40:06.957373 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.957307 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pmcz6" podStartSLOduration=4.60163152 podStartE2EDuration="23.957292553s" totalImagesPullingTime="19.355661033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:06.956615123 +0000 UTC m=+23.650302904" watchObservedRunningTime="2026-06-05 11:40:06.957292553 +0000 UTC m=+23.650980333" Jun 05 11:40:06.972961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:06.972907 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-z2p74" podStartSLOduration=4.627164513 podStartE2EDuration="23.972895299s" totalImagesPullingTime="19.345730786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:06.972615223 +0000 UTC m=+23.666303005" watchObservedRunningTime="2026-06-05 11:40:06.972895299 +0000 UTC m=+23.666583080" Jun 05 11:40:07.211996 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.211847 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 05 11:40:07.761006 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.760886 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-05T11:40:07.211988484Z","UUID":"6751f9e7-e123-4e3d-ae2b-f8be6201aacc","Handler":null,"Name":"","Endpoint":""} Jun 05 11:40:07.762652 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.762617 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 05 11:40:07.762809 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.762662 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 05 11:40:07.768523 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.768492 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:07.768647 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.768499 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:07.768717 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:07.768660 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:07.768717 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:07.768699 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:07.891774 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.891734 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" event={"ID":"c82695ff-4958-41f9-8252-c852506a84b7","Type":"ContainerStarted","Data":"5208b6e6b2e994121c7f43a3de4720e4c301409bc82b1a1b546c532b436bd2a4"} Jun 05 11:40:07.893456 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.893425 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8wq78" event={"ID":"b76b44dc-1800-47da-aea9-15676a1c27b6","Type":"ContainerStarted","Data":"32a3ec722733804e45e250efc20ec245c04e455f0194f1c0de3e323e3ccd4605"} Jun 05 11:40:07.909734 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:07.909669 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8wq78" podStartSLOduration=5.5793495029999995 podStartE2EDuration="24.909645617s" totalImagesPullingTime="19.330296114s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:07.909375916 +0000 UTC m=+24.603063696" watchObservedRunningTime="2026-06-05 11:40:07.909645617 +0000 UTC m=+24.603333399" Jun 05 11:40:08.467828 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.467736 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:40:08.468434 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.468415 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:40:08.768737 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.768698 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:08.768951 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:08.768856 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:08.898162 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.898125 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" event={"ID":"c82695ff-4958-41f9-8252-c852506a84b7","Type":"ContainerStarted","Data":"c599ca2a4bee45540b6b9298c8a401c753b45b2dc32cc2e526f65553f2881f0a"} Jun 05 11:40:08.901495 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.901472 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:40:08.901981 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.901959 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"e245881f7e3b83bbc479f7c00aa7e222a06743b4c6c1a94514b280d09775ae3d"} Jun 05 11:40:08.902227 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.902209 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:40:08.902699 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.902684 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l76v8" Jun 05 11:40:08.917739 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:08.917690 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-p6ggx" podStartSLOduration=4.933662967 podStartE2EDuration="25.917673766s" totalImagesPullingTime="20.984010799s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:08.917498271 +0000 UTC m=+25.611186073" watchObservedRunningTime="2026-06-05 11:40:08.917673766 +0000 UTC m=+25.611361543" Jun 05 11:40:09.768652 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:09.768595 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:09.768958 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:09.768621 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:09.768958 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:09.768760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:09.768958 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:09.768838 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:10.768359 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:10.768316 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:10.768918 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:10.768432 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:11.768399 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:11.768360 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:11.768896 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:11.768368 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:11.768896 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:11.768600 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:11.768896 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:11.768642 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:12.615708 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.615468 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lww9_b1a891d7-0d9d-469a-a558-5593b221f471/dns-node-resolver/0.log" Jun 05 11:40:12.768387 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.768353 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:12.768549 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:12.768455 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:12.916158 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.916078 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:40:12.916478 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.916454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"6a0065b654d64c84ee9782327a7919b453ef65243a922e3dd9135bc615593423"} Jun 05 11:40:12.916705 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.916686 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:12.916775 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.916756 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:12.916952 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.916927 2566 scope.go:117] "RemoveContainer" containerID="015b3ebfa53576d47110ca4cb572dc6cfd7c56d8a5c1dde8788cc91a40424645" Jun 05 11:40:12.918765 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.918737 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="fffd088077c8fa74c9cf6741169ca54e91dda74a03b2bab5f185b83bada9e9f3" exitCode=0 Jun 05 11:40:12.918884 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.918806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"fffd088077c8fa74c9cf6741169ca54e91dda74a03b2bab5f185b83bada9e9f3"} Jun 05 11:40:12.933706 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:12.933688 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:13.785069 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.784835 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2p74_942f21a4-4334-4203-be51-0f47efa7d7ae/node-ca/0.log" Jun 05 11:40:13.785887 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.785866 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:13.785987 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.785890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:13.786062 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:13.785991 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:13.786144 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:13.786116 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:13.925599 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.925571 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:40:13.925968 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.925940 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" event={"ID":"9df92fe6-ac1e-40af-8a62-d9951836caf0","Type":"ContainerStarted","Data":"4de33baaf61d37f9536f4d6db69483bd7fe3e48cb8a6c0ce461f357eb250e444"} Jun 05 11:40:13.926154 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.926134 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:13.943191 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.943164 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:13.954424 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:13.954369 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" podStartSLOduration=11.581385496 podStartE2EDuration="30.954350156s" totalImagesPullingTime="19.37296466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:13.952742139 +0000 UTC m=+30.646429920" watchObservedRunningTime="2026-06-05 11:40:13.954350156 +0000 UTC m=+30.648037939" Jun 05 11:40:14.409771 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.409631 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mctkq"] Jun 05 11:40:14.409968 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.409810 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:14.409968 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:14.409936 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:14.410264 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.410244 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c6g7h"] Jun 05 11:40:14.410341 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.410331 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:14.410411 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:14.410396 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:14.413504 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.413478 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lls8g"] Jun 05 11:40:14.413618 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.413574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:14.413672 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:14.413655 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:14.930089 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.930051 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="78c24a80b8f5a85362d6498b78b8c0c58ea0c695bdde6ff59505259b68d24f71" exitCode=0 Jun 05 11:40:14.930701 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:14.930143 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"78c24a80b8f5a85362d6498b78b8c0c58ea0c695bdde6ff59505259b68d24f71"} Jun 05 11:40:15.768198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:15.768161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:15.768198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:15.768196 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:15.768398 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:15.768161 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:15.768398 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:15.768291 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:15.768398 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:15.768356 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:15.768482 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:15.768440 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:15.935378 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:15.935294 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="4b1461fc3119ab72cdd1a919041d3ed5c6fa763932444947dd312000b49efd54" exitCode=0 Jun 05 11:40:15.935822 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:15.935374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"4b1461fc3119ab72cdd1a919041d3ed5c6fa763932444947dd312000b49efd54"} Jun 05 11:40:17.453101 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.453064 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:17.453543 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.453133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:17.453543 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.453240 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:17.453543 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.453251 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:17.453543 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.453324 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:49.45330606 +0000 UTC m=+66.146993822 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:17.453543 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.453347 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:40:49.453338005 +0000 UTC m=+66.147025787 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:17.553876 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.553838 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:17.554081 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.553994 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:40:17.554081 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.554010 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:40:17.554081 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.554019 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:17.554081 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.554074 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:40:49.55405745 +0000 UTC m=+66.247745209 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:17.768263 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.768228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:17.768263 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.768228 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:17.768521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:17.768276 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:17.768521 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.768406 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:17.768627 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.768544 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:17.768689 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:17.768633 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:19.769116 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:19.768904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:19.769592 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:19.768904 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:19.769592 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:19.769224 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:19.769592 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:19.768916 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:19.769592 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:19.769324 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:19.769592 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:19.769356 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:20.949972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:20.949936 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="54848295fa73ed6f0a0245d8afa4be0d60da67f470a2133be5de3a95b864cb42" exitCode=0 Jun 05 11:40:20.950340 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:20.949982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"54848295fa73ed6f0a0245d8afa4be0d60da67f470a2133be5de3a95b864cb42"} Jun 05 11:40:21.771575 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:21.771543 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:21.771745 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:21.771639 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:21.771745 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:21.771648 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:21.771745 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:21.771722 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:21.771745 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:21.771728 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:21.771900 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:21.771803 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:21.955423 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:21.955387 2566 generic.go:356] "Generic (PLEG): container finished" podID="b157d1ff-fd36-4f19-8f47-5122f2a154ba" containerID="29b9dc6f2d306ccb0cb99f83c06db92302f93c36ccffb3c18ab544adb47296b5" exitCode=0 Jun 05 11:40:21.955841 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:21.955444 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerDied","Data":"29b9dc6f2d306ccb0cb99f83c06db92302f93c36ccffb3c18ab544adb47296b5"} Jun 05 11:40:22.960494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:22.960454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" event={"ID":"b157d1ff-fd36-4f19-8f47-5122f2a154ba","Type":"ContainerStarted","Data":"480a4707e5b90200d4b1a8b968fa83cacf31b20d20c8cc3efd5b96e808efaae0"} Jun 05 11:40:22.985941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:22.985893 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9x2fd" podStartSLOduration=8.929024597 podStartE2EDuration="39.985877956s" totalImagesPullingTime="31.056853359s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:22.985524016 +0000 UTC m=+39.679211797" watchObservedRunningTime="2026-06-05 11:40:22.985877956 +0000 UTC m=+39.679565737" Jun 05 11:40:23.770919 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:23.770889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:23.771086 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:23.770983 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:23.771086 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:23.770998 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:23.771086 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:23.771057 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:23.771195 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:23.771093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:23.771195 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:23.771185 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:25.771709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:25.771674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:25.772119 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:25.771769 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:25.772119 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:25.771774 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:25.772119 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:25.771871 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:25.772119 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:25.771918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:25.772119 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:25.771973 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:27.768874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:27.768829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:27.768874 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:27.768881 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:27.769375 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:27.768890 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:27.769375 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:27.768982 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:27.769375 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:27.769014 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:27.769375 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:27.769184 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:29.768654 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:29.768621 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:29.768654 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:29.768652 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:29.769147 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:29.768622 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:29.769147 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:29.768728 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:29.769147 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:29.768819 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:29.769147 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:29.768911 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:31.767958 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:31.767918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:31.767958 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:31.767942 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:31.768386 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:31.767918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:31.768386 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:31.768051 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:31.768386 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:31.768129 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:31.768386 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:31.768230 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:33.769482 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:33.769452 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:33.769897 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:33.769547 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:33.769897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:33.769627 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:33.769897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:33.769733 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:33.769897 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:33.769749 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:33.769897 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:33.769821 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:35.768996 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:35.768955 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:35.769444 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:35.768955 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:35.769444 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:35.769079 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:35.769444 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:35.768957 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:35.769444 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:35.769164 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:35.769444 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:35.769298 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:37.768801 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:37.768742 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:37.768801 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:37.768780 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:37.769355 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:37.768758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:37.769355 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:37.768904 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:37.769355 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:37.768954 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:37.769355 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:37.769022 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:39.768713 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:39.768678 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:39.769115 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:39.768678 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:39.769115 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:39.768779 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:39.769115 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:39.768824 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:39.769115 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:39.768914 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:39.769115 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:39.768973 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:41.771905 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:41.771855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:41.772292 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:41.771910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:41.772292 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:41.771914 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:41.772292 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:41.771994 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:41.772292 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:41.772078 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:41.772292 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:41.772155 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:43.771606 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:43.771574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:43.771997 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:43.771676 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:43.771997 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:43.771579 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:43.771997 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:43.771574 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:43.771997 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:43.771760 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:43.771997 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:43.771867 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:45.771062 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:45.771031 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:45.771541 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:45.771122 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:45.771541 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:45.771124 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:45.771541 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:45.771129 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:45.771541 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:45.771295 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:45.771541 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:45.771411 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:45.950289 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:45.950264 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rkx2v" Jun 05 11:40:47.768132 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:47.768095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:47.768609 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:47.768093 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:47.768609 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:47.768230 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:47.768609 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:47.768095 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:47.768609 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:47.768280 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:47.768609 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:47.768365 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:49.476716 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.476673 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:49.477134 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.476735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:49.477134 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.476856 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:49.477134 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.476856 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:49.477134 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.476921 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret podName:24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf nodeName:}" failed. No retries permitted until 2026-06-05 11:41:53.476902116 +0000 UTC m=+130.170589876 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret") pod "global-pull-secret-syncer-mctkq" (UID: "24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf") : object "kube-system"/"original-pull-secret" not registered Jun 05 11:40:49.477134 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.476936 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs podName:c4fb895e-e304-4f18-ae1e-d34316ba5ce9 nodeName:}" failed. No retries permitted until 2026-06-05 11:41:53.476929175 +0000 UTC m=+130.170616934 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs") pod "network-metrics-daemon-lls8g" (UID: "c4fb895e-e304-4f18-ae1e-d34316ba5ce9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 05 11:40:49.578053 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.578008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:49.578236 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.578206 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 05 11:40:49.578236 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.578230 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 05 11:40:49.578321 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.578242 2566 projected.go:196] Error preparing data for projected volume kube-api-access-tgj2m for pod openshift-network-diagnostics/network-check-target-c6g7h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:49.578321 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.578306 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m podName:94becad8-2357-4ffd-a254-0ad3338b7e4c nodeName:}" failed. No retries permitted until 2026-06-05 11:41:53.578291438 +0000 UTC m=+130.271979214 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "kube-api-access-tgj2m" (UniqueName: "kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m") pod "network-check-target-c6g7h" (UID: "94becad8-2357-4ffd-a254-0ad3338b7e4c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 05 11:40:49.768646 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.768548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:49.768836 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.768548 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:49.768836 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.768671 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lls8g" podUID="c4fb895e-e304-4f18-ae1e-d34316ba5ce9" Jun 05 11:40:49.768836 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:49.768688 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:49.768836 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.768770 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mctkq" podUID="24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf" Jun 05 11:40:49.768986 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:49.768852 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-c6g7h" podUID="94becad8-2357-4ffd-a254-0ad3338b7e4c" Jun 05 11:40:50.115509 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.115421 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-129.ec2.internal" event="NodeReady" Jun 05 11:40:50.115677 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.115581 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 05 11:40:50.156624 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.156594 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8548c45f8c-4f2gm"] Jun 05 11:40:50.158270 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.158253 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.161057 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.161030 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 05 11:40:50.161170 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.161114 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mwwwc\"" Jun 05 11:40:50.161397 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.161374 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 05 11:40:50.161491 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.161378 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 05 11:40:50.166199 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.166181 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 05 11:40:50.194915 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.194870 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8548c45f8c-4f2gm"] Jun 05 11:40:50.195428 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.195411 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r9vvr"] Jun 05 11:40:50.196973 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.196950 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-527wx"] Jun 05 11:40:50.197109 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.197091 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.198698 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.198679 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.199827 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.199808 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l8lmn\"" Jun 05 11:40:50.200034 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.200021 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 05 11:40:50.201294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.201273 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 05 11:40:50.201394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.201278 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 05 11:40:50.201471 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.201452 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 05 11:40:50.201571 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.201557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-th6wv\"" Jun 05 11:40:50.201634 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.201624 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 05 11:40:50.213065 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.213038 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-527wx"] Jun 05 11:40:50.213842 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.213820 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r9vvr"] Jun 05 11:40:50.227951 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.227921 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zxsqw"] Jun 05 11:40:50.229681 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.229666 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.234965 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:50.234933 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap" Jun 05 11:40:50.235094 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:50.234993 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-tls\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" type="*v1.Secret" Jun 05 11:40:50.235094 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:50.235054 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"insights-runtime-extractor-sa-dockercfg-lk2jq\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lk2jq\"" type="*v1.Secret" Jun 05 11:40:50.235781 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:50.235757 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 05 11:40:50.236389 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:50.236367 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap" Jun 05 11:40:50.263264 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.263233 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxsqw"] Jun 05 11:40:50.283884 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.283854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-registry-tls\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.283884 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.283887 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-trusted-ca\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.283906 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxwjs\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-kube-api-access-pxwjs\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.283966 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-installation-pull-secrets\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.284026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-registry-certificates\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.284044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-bound-sa-token\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.284080 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-image-registry-private-configuration\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.284113 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.284100 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/097e7c15-fb94-448a-8bee-1839deb5600c-ca-trust-extracted\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385415 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/917c3121-726b-4d66-858e-04433d761cb2-config-volume\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.385415 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385384 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-registry-tls\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-cert\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385488 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z6f5\" (UniqueName: \"kubernetes.io/projected/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-kube-api-access-4z6f5\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385531 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-trusted-ca\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385555 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxwjs\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-kube-api-access-pxwjs\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385589 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.385645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385621 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-data-volume\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385651 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-installation-pull-secrets\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385692 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/917c3121-726b-4d66-858e-04433d761cb2-metrics-tls\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2msd\" (UniqueName: \"kubernetes.io/projected/917c3121-726b-4d66-858e-04433d761cb2-kube-api-access-s2msd\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385782 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-registry-certificates\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385833 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-bound-sa-token\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-image-registry-private-configuration\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385885 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/097e7c15-fb94-448a-8bee-1839deb5600c-ca-trust-extracted\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-crio-socket\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385934 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtwf5\" (UniqueName: \"kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.385972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385957 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c3121-726b-4d66-858e-04433d761cb2-tmp-dir\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.386409 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.385986 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.386409 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.386252 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/097e7c15-fb94-448a-8bee-1839deb5600c-ca-trust-extracted\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.386574 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.386551 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-registry-certificates\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.386701 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.386680 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/097e7c15-fb94-448a-8bee-1839deb5600c-trusted-ca\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.389742 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.389717 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-image-registry-private-configuration\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.389910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.389746 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/097e7c15-fb94-448a-8bee-1839deb5600c-installation-pull-secrets\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.389910 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.389880 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-registry-tls\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.394860 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.394836 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-bound-sa-token\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.395200 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.395180 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxwjs\" (UniqueName: \"kubernetes.io/projected/097e7c15-fb94-448a-8bee-1839deb5600c-kube-api-access-pxwjs\") pod \"image-registry-8548c45f8c-4f2gm\" (UID: \"097e7c15-fb94-448a-8bee-1839deb5600c\") " pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.467049 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.467015 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:50.486748 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486711 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.486748 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-data-volume\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486774 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/917c3121-726b-4d66-858e-04433d761cb2-metrics-tls\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2msd\" (UniqueName: \"kubernetes.io/projected/917c3121-726b-4d66-858e-04433d761cb2-kube-api-access-s2msd\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486932 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-crio-socket\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtwf5\" (UniqueName: \"kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.486994 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c3121-726b-4d66-858e-04433d761cb2-tmp-dir\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487026 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487052 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/917c3121-726b-4d66-858e-04433d761cb2-config-volume\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487055 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-crio-socket\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487131 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-cert\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487138 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-data-volume\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:50.487257 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487157 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z6f5\" (UniqueName: \"kubernetes.io/projected/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-kube-api-access-4z6f5\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.487701 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487372 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/917c3121-726b-4d66-858e-04433d761cb2-tmp-dir\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.487872 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.487850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/917c3121-726b-4d66-858e-04433d761cb2-config-volume\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.489434 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.489409 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/917c3121-726b-4d66-858e-04433d761cb2-metrics-tls\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.489761 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.489736 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-cert\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.495304 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.495278 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2msd\" (UniqueName: \"kubernetes.io/projected/917c3121-726b-4d66-858e-04433d761cb2-kube-api-access-s2msd\") pod \"dns-default-527wx\" (UID: \"917c3121-726b-4d66-858e-04433d761cb2\") " pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.495496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.495479 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z6f5\" (UniqueName: \"kubernetes.io/projected/c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04-kube-api-access-4z6f5\") pod \"ingress-canary-r9vvr\" (UID: \"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04\") " pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.507686 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.507656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r9vvr" Jun 05 11:40:50.512484 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.512468 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-527wx" Jun 05 11:40:50.626169 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.626142 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8548c45f8c-4f2gm"] Jun 05 11:40:50.629943 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:40:50.629912 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod097e7c15_fb94_448a_8bee_1839deb5600c.slice/crio-e37ca87e5ea264d19e8fc4b7146376e0a3b337b27f7408910f89d1054a6d7118 WatchSource:0}: Error finding container e37ca87e5ea264d19e8fc4b7146376e0a3b337b27f7408910f89d1054a6d7118: Status 404 returned error can't find the container with id e37ca87e5ea264d19e8fc4b7146376e0a3b337b27f7408910f89d1054a6d7118 Jun 05 11:40:50.671856 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.671779 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-527wx"] Jun 05 11:40:50.683712 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:40:50.683678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod917c3121_726b_4d66_858e_04433d761cb2.slice/crio-d8b0b177c2e61e9e899faa2c217198f99c23cc2cbb93187600c3b0a205609d61 WatchSource:0}: Error finding container d8b0b177c2e61e9e899faa2c217198f99c23cc2cbb93187600c3b0a205609d61: Status 404 returned error can't find the container with id d8b0b177c2e61e9e899faa2c217198f99c23cc2cbb93187600c3b0a205609d61 Jun 05 11:40:50.683932 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:50.683849 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r9vvr"] Jun 05 11:40:50.686566 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:40:50.686545 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4f9579d_fd82_4944_a0d6_0d7f1a3e4c04.slice/crio-3e94aeffac3908828d56fb4c9034807adc836ad5e3bac31967e9f1916e162d9a WatchSource:0}: Error finding container 3e94aeffac3908828d56fb4c9034807adc836ad5e3bac31967e9f1916e162d9a: Status 404 returned error can't find the container with id 3e94aeffac3908828d56fb4c9034807adc836ad5e3bac31967e9f1916e162d9a Jun 05 11:40:51.021838 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.021780 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-527wx" event={"ID":"917c3121-726b-4d66-858e-04433d761cb2","Type":"ContainerStarted","Data":"d8b0b177c2e61e9e899faa2c217198f99c23cc2cbb93187600c3b0a205609d61"} Jun 05 11:40:51.022979 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.022945 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r9vvr" event={"ID":"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04","Type":"ContainerStarted","Data":"3e94aeffac3908828d56fb4c9034807adc836ad5e3bac31967e9f1916e162d9a"} Jun 05 11:40:51.024495 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.024469 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" event={"ID":"097e7c15-fb94-448a-8bee-1839deb5600c","Type":"ContainerStarted","Data":"39d1b39b1cdf47fc4ecde0170565d0ce88a139c9257cb4c3bf70b4338bba966e"} Jun 05 11:40:51.024629 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.024512 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" event={"ID":"097e7c15-fb94-448a-8bee-1839deb5600c","Type":"ContainerStarted","Data":"e37ca87e5ea264d19e8fc4b7146376e0a3b337b27f7408910f89d1054a6d7118"} Jun 05 11:40:51.024629 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.024553 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:40:51.045656 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.045603 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" podStartSLOduration=3.04558694 podStartE2EDuration="3.04558694s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:51.044676235 +0000 UTC m=+67.738364018" watchObservedRunningTime="2026-06-05 11:40:51.04558694 +0000 UTC m=+67.739274699" Jun 05 11:40:51.071827 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.071761 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 05 11:40:51.079591 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.079553 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:51.468391 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.468311 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 05 11:40:51.478243 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.478207 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:51.493287 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:51.493253 2566 projected.go:291] Couldn't get configMap openshift-insights/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition Jun 05 11:40:51.562338 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.562304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 05 11:40:51.595699 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.595663 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lk2jq\"" Jun 05 11:40:51.738363 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.738326 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 05 11:40:51.743650 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:51.743605 2566 projected.go:196] Error preparing data for projected volume kube-api-access-dtwf5 for pod openshift-insights/insights-runtime-extractor-zxsqw: failed to sync configmap cache: timed out waiting for the condition Jun 05 11:40:51.743842 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:40:51.743695 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5 podName:c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6 nodeName:}" failed. No retries permitted until 2026-06-05 11:40:52.243676743 +0000 UTC m=+68.937364503 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dtwf5" (UniqueName: "kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5") pod "insights-runtime-extractor-zxsqw" (UID: "c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6") : failed to sync configmap cache: timed out waiting for the condition Jun 05 11:40:51.768059 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.768027 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:40:51.768059 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.768060 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:40:51.768293 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.768032 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:40:51.771665 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.771642 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 11:40:51.772941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.772580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 11:40:51.772941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.772648 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqqvn\"" Jun 05 11:40:51.772941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.772696 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 11:40:51.772941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.772805 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7949z\"" Jun 05 11:40:51.772941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.772857 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 11:40:51.792008 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.791975 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:40:51.793897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.793879 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.796732 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.796713 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 05 11:40:51.796873 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.796819 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 05 11:40:51.796941 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.796892 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 05 11:40:51.797066 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.797050 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 05 11:40:51.797133 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.797078 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bbclh\"" Jun 05 11:40:51.797202 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.797081 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 05 11:40:51.797202 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.797172 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 05 11:40:51.797602 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.797301 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 05 11:40:51.804453 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.804420 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:40:51.900724 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.900898 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29s9b\" (UniqueName: \"kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.900898 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900825 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.900898 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.901068 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:51.901068 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:51.900972 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002171 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002171 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002166 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002198 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29s9b\" (UniqueName: \"kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.002408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.002309 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.003119 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.003089 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.003229 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.003183 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.003416 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.003388 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.005461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.005433 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.006033 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.006012 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.011370 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.011346 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29s9b\" (UniqueName: \"kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b\") pod \"console-754b544cbc-8q9k6\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.106070 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.106034 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:40:52.305177 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.305084 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtwf5\" (UniqueName: \"kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:52.307719 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.307693 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtwf5\" (UniqueName: \"kubernetes.io/projected/c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6-kube-api-access-dtwf5\") pod \"insights-runtime-extractor-zxsqw\" (UID: \"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6\") " pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:52.337813 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.337758 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zxsqw" Jun 05 11:40:52.922904 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.922298 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:40:52.943323 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:52.942527 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zxsqw"] Jun 05 11:40:52.946364 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:40:52.946330 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e3db9d_fa3f_40b9_b84d_afc4ee4b30f6.slice/crio-e261a1b692edfaaa471a9cb4f2257d2a32ad106fb3bef7e96c43de2ba5fc6721 WatchSource:0}: Error finding container e261a1b692edfaaa471a9cb4f2257d2a32ad106fb3bef7e96c43de2ba5fc6721: Status 404 returned error can't find the container with id e261a1b692edfaaa471a9cb4f2257d2a32ad106fb3bef7e96c43de2ba5fc6721 Jun 05 11:40:53.032920 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.032750 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r9vvr" event={"ID":"c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04","Type":"ContainerStarted","Data":"480a145dc0139345592493ee2c2edf3d54551e7101e709fe02bdb4f3f6a856d8"} Jun 05 11:40:53.034253 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.034229 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b544cbc-8q9k6" event={"ID":"9d7e30c9-bff7-4760-99bb-3e943d72e7ad","Type":"ContainerStarted","Data":"3da2a36aea04f90c6ce6401e9f292eae2d667e3b950b57e39dd0f8e9661dba2a"} Jun 05 11:40:53.035828 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.035807 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-527wx" event={"ID":"917c3121-726b-4d66-858e-04433d761cb2","Type":"ContainerStarted","Data":"e4a2469f8d51c5621a8b2856f154b1c07c44ac02f782d38586647cbc3194a01a"} Jun 05 11:40:53.035883 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.035851 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-527wx" event={"ID":"917c3121-726b-4d66-858e-04433d761cb2","Type":"ContainerStarted","Data":"bdbee87c9ba52875087a665e63eeea09392a373af4d65f08a110fe459c0307c5"} Jun 05 11:40:53.035965 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.035945 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-527wx" Jun 05 11:40:53.040098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.040078 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxsqw" event={"ID":"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6","Type":"ContainerStarted","Data":"89c1323e7287b689a2e0e08e7a57acfff4e91b81248f34ae8519b11b3732d0dc"} Jun 05 11:40:53.040193 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.040118 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxsqw" event={"ID":"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6","Type":"ContainerStarted","Data":"e261a1b692edfaaa471a9cb4f2257d2a32ad106fb3bef7e96c43de2ba5fc6721"} Jun 05 11:40:53.053295 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.053250 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r9vvr" podStartSLOduration=0.988081543 podStartE2EDuration="3.053236962s" totalImagesPullingTime="2.065155419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:53.051887571 +0000 UTC m=+69.745575351" watchObservedRunningTime="2026-06-05 11:40:53.053236962 +0000 UTC m=+69.746924742" Jun 05 11:40:53.068293 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:53.068243 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-527wx" podStartSLOduration=1.004484252 podStartE2EDuration="3.068226377s" totalImagesPullingTime="2.063742125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:53.067458645 +0000 UTC m=+69.761146438" watchObservedRunningTime="2026-06-05 11:40:53.068226377 +0000 UTC m=+69.761914137" Jun 05 11:40:54.054727 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:54.054670 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxsqw" event={"ID":"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6","Type":"ContainerStarted","Data":"2c824124f19773da3f2de23184601c6281ae385d6b4d6f1b6ebd0540aa69c199"} Jun 05 11:40:56.063383 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:56.063341 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b544cbc-8q9k6" event={"ID":"9d7e30c9-bff7-4760-99bb-3e943d72e7ad","Type":"ContainerStarted","Data":"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17"} Jun 05 11:40:56.065579 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:56.065549 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zxsqw" event={"ID":"c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6","Type":"ContainerStarted","Data":"ba60e99d240b42e31e97e0f0d4b7c457b8446eb6f2b396c0055ca7e60cb64732"} Jun 05 11:40:56.083885 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:56.083827 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-754b544cbc-8q9k6" podStartSLOduration=2.038815499 podStartE2EDuration="5.083810276s" totalImagesPullingTime="3.044994777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:40:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:56.08340726 +0000 UTC m=+72.777095042" watchObservedRunningTime="2026-06-05 11:40:56.083810276 +0000 UTC m=+72.777498048" Jun 05 11:40:56.100279 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:40:56.100230 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zxsqw" podStartSLOduration=3.164340372 podStartE2EDuration="6.100213746s" totalImagesPullingTime="2.935873374s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:40:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:40:56.099865516 +0000 UTC m=+72.793553296" watchObservedRunningTime="2026-06-05 11:40:56.100213746 +0000 UTC m=+72.793901529" Jun 05 11:41:02.107093 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:02.107053 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:02.107558 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:02.107120 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:02.112009 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:02.111990 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:03.056943 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:03.056908 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-527wx" Jun 05 11:41:03.092028 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:03.091984 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:04.347913 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.347842 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p"] Jun 05 11:41:04.350486 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.350469 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.353174 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.353149 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 05 11:41:04.353174 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.353169 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 05 11:41:04.353464 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.353449 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 05 11:41:04.354390 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.354370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-4g9b7\"" Jun 05 11:41:04.354390 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.354390 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 05 11:41:04.354528 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.354402 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 05 11:41:04.358591 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.358569 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m"] Jun 05 11:41:04.360435 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.360417 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.361241 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.361215 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p"] Jun 05 11:41:04.363201 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.363179 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 05 11:41:04.363313 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.363256 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tkrcg\"" Jun 05 11:41:04.363313 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.363269 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 05 11:41:04.363703 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.363683 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 05 11:41:04.378356 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.378327 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m"] Jun 05 11:41:04.380176 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.380154 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wtbts"] Jun 05 11:41:04.382227 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.382210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.384618 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.384596 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 05 11:41:04.384618 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.384614 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-82wfl\"" Jun 05 11:41:04.384807 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.384672 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 05 11:41:04.384807 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.384605 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 05 11:41:04.397360 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397338 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-textfile\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397390 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.397461 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397415 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.397576 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397546 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.397647 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dea6d84a-abf2-4e97-ac14-0018ef52671c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.397691 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397669 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-root\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397741 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397691 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397741 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397725 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.397862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397776 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzsvq\" (UniqueName: \"kubernetes.io/projected/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-kube-api-access-wzsvq\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.397862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397831 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-tls\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397948 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397876 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-sys\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.397948 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397903 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.397948 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.397948 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397932 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-metrics-client-ca\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.398118 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397963 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbw68\" (UniqueName: \"kubernetes.io/projected/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-api-access-mbw68\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.398118 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.397990 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmv4\" (UniqueName: \"kubernetes.io/projected/db62c3be-2181-41c2-ba8b-7262c33e3b8d-kube-api-access-twmv4\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.398118 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.398038 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-wtmp\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.398248 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.398138 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.498939 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.498903 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.498939 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.498947 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.499188 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.498967 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-metrics-client-ca\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499188 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:04.499069 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jun 05 11:41:04.499188 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbw68\" (UniqueName: \"kubernetes.io/projected/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-api-access-mbw68\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.499188 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:04.499151 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls podName:dea6d84a-abf2-4e97-ac14-0018ef52671c nodeName:}" failed. No retries permitted until 2026-06-05 11:41:04.999132115 +0000 UTC m=+81.692819875 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls") pod "kube-state-metrics-57bbf8bfb5-n4m9m" (UID: "dea6d84a-abf2-4e97-ac14-0018ef52671c") : secret "kube-state-metrics-tls" not found Jun 05 11:41:04.499188 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499184 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmv4\" (UniqueName: \"kubernetes.io/projected/db62c3be-2181-41c2-ba8b-7262c33e3b8d-kube-api-access-twmv4\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499211 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-wtmp\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499243 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499271 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-textfile\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499293 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499327 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499361 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499383 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-wtmp\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499442 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499455 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dea6d84a-abf2-4e97-ac14-0018ef52671c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-root\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499528 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499566 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499575 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-metrics-client-ca\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499601 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzsvq\" (UniqueName: \"kubernetes.io/projected/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-kube-api-access-wzsvq\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-tls\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499668 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-sys\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499667 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-root\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.499862 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499827 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.500520 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.499901 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/dea6d84a-abf2-4e97-ac14-0018ef52671c-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.500520 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.500152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.500520 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.500211 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/db62c3be-2181-41c2-ba8b-7262c33e3b8d-sys\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.500520 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.500444 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-accelerators-collector-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.500520 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.500501 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-textfile\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.500956 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:04.500928 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 11:41:04.501316 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.500977 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.501316 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:04.500996 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls podName:0d2b9955-82ea-48f3-bf0b-d29e7ccd299d nodeName:}" failed. No retries permitted until 2026-06-05 11:41:05.000977517 +0000 UTC m=+81.694665300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-wxk4p" (UID: "0d2b9955-82ea-48f3-bf0b-d29e7ccd299d") : secret "openshift-state-metrics-tls" not found Jun 05 11:41:04.502161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.502139 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.502283 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.502225 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.502762 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.502743 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.503075 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.503052 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/db62c3be-2181-41c2-ba8b-7262c33e3b8d-node-exporter-tls\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.507632 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.507605 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmv4\" (UniqueName: \"kubernetes.io/projected/db62c3be-2181-41c2-ba8b-7262c33e3b8d-kube-api-access-twmv4\") pod \"node-exporter-wtbts\" (UID: \"db62c3be-2181-41c2-ba8b-7262c33e3b8d\") " pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.508077 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.508056 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbw68\" (UniqueName: \"kubernetes.io/projected/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-api-access-mbw68\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:04.508709 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.508679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzsvq\" (UniqueName: \"kubernetes.io/projected/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-kube-api-access-wzsvq\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:04.690984 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:04.690897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wtbts" Jun 05 11:41:04.700702 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:04.700673 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb62c3be_2181_41c2_ba8b_7262c33e3b8d.slice/crio-fc78c15dc2dc4f5b9850818df752789b146ff231061ceb6d112c67f79aa9b57f WatchSource:0}: Error finding container fc78c15dc2dc4f5b9850818df752789b146ff231061ceb6d112c67f79aa9b57f: Status 404 returned error can't find the container with id fc78c15dc2dc4f5b9850818df752789b146ff231061ceb6d112c67f79aa9b57f Jun 05 11:41:05.004856 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.004819 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:05.005051 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.004894 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:05.005051 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:05.005009 2566 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 05 11:41:05.005135 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:05.005061 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls podName:0d2b9955-82ea-48f3-bf0b-d29e7ccd299d nodeName:}" failed. No retries permitted until 2026-06-05 11:41:06.005047723 +0000 UTC m=+82.698735482 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-wxk4p" (UID: "0d2b9955-82ea-48f3-bf0b-d29e7ccd299d") : secret "openshift-state-metrics-tls" not found Jun 05 11:41:05.007436 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.007404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/dea6d84a-abf2-4e97-ac14-0018ef52671c-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-n4m9m\" (UID: \"dea6d84a-abf2-4e97-ac14-0018ef52671c\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:05.094197 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.094157 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbts" event={"ID":"db62c3be-2181-41c2-ba8b-7262c33e3b8d","Type":"ContainerStarted","Data":"fc78c15dc2dc4f5b9850818df752789b146ff231061ceb6d112c67f79aa9b57f"} Jun 05 11:41:05.269707 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.269636 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" Jun 05 11:41:05.600133 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:05.600100 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m"] Jun 05 11:41:05.602931 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:05.602902 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddea6d84a_abf2_4e97_ac14_0018ef52671c.slice/crio-31ed511f2ada9db0e1fa4b0a8766fd2f8ae1c82306028d93c82bf578dee415d7 WatchSource:0}: Error finding container 31ed511f2ada9db0e1fa4b0a8766fd2f8ae1c82306028d93c82bf578dee415d7: Status 404 returned error can't find the container with id 31ed511f2ada9db0e1fa4b0a8766fd2f8ae1c82306028d93c82bf578dee415d7 Jun 05 11:41:06.016378 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.016346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:06.018860 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.018831 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0d2b9955-82ea-48f3-bf0b-d29e7ccd299d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-wxk4p\" (UID: \"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:06.099742 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.099695 2566 generic.go:356] "Generic (PLEG): container finished" podID="db62c3be-2181-41c2-ba8b-7262c33e3b8d" containerID="ce5c4da7c716dd933c27ab239e9004fc6f7152f9201c07b0aeff0a0f4a55bd0a" exitCode=0 Jun 05 11:41:06.099946 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.099806 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbts" event={"ID":"db62c3be-2181-41c2-ba8b-7262c33e3b8d","Type":"ContainerDied","Data":"ce5c4da7c716dd933c27ab239e9004fc6f7152f9201c07b0aeff0a0f4a55bd0a"} Jun 05 11:41:06.101939 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.101909 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" event={"ID":"dea6d84a-abf2-4e97-ac14-0018ef52671c","Type":"ContainerStarted","Data":"31ed511f2ada9db0e1fa4b0a8766fd2f8ae1c82306028d93c82bf578dee415d7"} Jun 05 11:41:06.160198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.160162 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" Jun 05 11:41:06.315764 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:06.315668 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p"] Jun 05 11:41:06.319331 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:06.319295 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d2b9955_82ea_48f3_bf0b_d29e7ccd299d.slice/crio-05eed8c6816cbb321fd1b5a96bd23d4e7f7e3f195b16e3ff932a61eeaf047c0f WatchSource:0}: Error finding container 05eed8c6816cbb321fd1b5a96bd23d4e7f7e3f195b16e3ff932a61eeaf047c0f: Status 404 returned error can't find the container with id 05eed8c6816cbb321fd1b5a96bd23d4e7f7e3f195b16e3ff932a61eeaf047c0f Jun 05 11:41:07.109264 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.109171 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" event={"ID":"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d","Type":"ContainerStarted","Data":"569ba688113ee3bd2354db3dfcf3eb280186db022dab8bc15b26fccddfb434c4"} Jun 05 11:41:07.109677 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.109250 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" event={"ID":"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d","Type":"ContainerStarted","Data":"18e2032d73e7a850446ac728d41d36e51cd8fa86c41c1f809b714ab58a77169d"} Jun 05 11:41:07.109677 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.109300 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" event={"ID":"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d","Type":"ContainerStarted","Data":"05eed8c6816cbb321fd1b5a96bd23d4e7f7e3f195b16e3ff932a61eeaf047c0f"} Jun 05 11:41:07.112340 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.112316 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbts" event={"ID":"db62c3be-2181-41c2-ba8b-7262c33e3b8d","Type":"ContainerStarted","Data":"465d43d7a4846533f9e2727d4e49af6e7ab2e0fe91d9659b6244048377fa290b"} Jun 05 11:41:07.112478 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.112369 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wtbts" event={"ID":"db62c3be-2181-41c2-ba8b-7262c33e3b8d","Type":"ContainerStarted","Data":"94ce9ff33c4f964693e6e7bc10a4129e794811a562787779c55d0177ea77debf"} Jun 05 11:41:07.121167 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.121122 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" event={"ID":"dea6d84a-abf2-4e97-ac14-0018ef52671c","Type":"ContainerStarted","Data":"541c4b10670dbb837e465bff8d1b2b36286ed7073c98f196f752735f3977c63d"} Jun 05 11:41:07.121328 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.121298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" event={"ID":"dea6d84a-abf2-4e97-ac14-0018ef52671c","Type":"ContainerStarted","Data":"b7cbdaf0dccc20641d7ab79699f9c6cdc93134d2aff8a0d5104f360b98fe2c8f"} Jun 05 11:41:07.121429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.121343 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" event={"ID":"dea6d84a-abf2-4e97-ac14-0018ef52671c","Type":"ContainerStarted","Data":"7ae3bc04da69ff375e50603b2b32ccccf4bcf7ccff9e247cdcc14202c35b4372"} Jun 05 11:41:07.140162 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.140106 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wtbts" podStartSLOduration=2.279066519 podStartE2EDuration="3.140088162s" totalImagesPullingTime="783.897866ms" totalInitContainerRuntime="77.123777ms" isStatefulPod=true podCreationTimestamp="2026-06-05 11:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:07.138736911 +0000 UTC m=+83.832424693" watchObservedRunningTime="2026-06-05 11:41:07.140088162 +0000 UTC m=+83.833775942" Jun 05 11:41:07.161112 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:07.161050 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-n4m9m" podStartSLOduration=1.958728855 podStartE2EDuration="3.161024784s" totalImagesPullingTime="1.202295929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:07.159531077 +0000 UTC m=+83.853218861" watchObservedRunningTime="2026-06-05 11:41:07.161024784 +0000 UTC m=+83.854712566" Jun 05 11:41:08.126602 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:08.126560 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" event={"ID":"0d2b9955-82ea-48f3-bf0b-d29e7ccd299d","Type":"ContainerStarted","Data":"1e5103ca41972c133db6656b68a7805d26d43f120b924d9e787240a7eba2dd4d"} Jun 05 11:41:08.149047 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:08.148987 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-wxk4p" podStartSLOduration=3.159838046 podStartE2EDuration="4.148964753s" totalImagesPullingTime="989.126707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:08.148763014 +0000 UTC m=+84.842450797" watchObservedRunningTime="2026-06-05 11:41:08.148964753 +0000 UTC m=+84.842652536" Jun 05 11:41:09.562393 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.562356 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-9f4467c6-drffk"] Jun 05 11:41:09.564505 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.564485 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.567062 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567032 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 05 11:41:09.567191 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567093 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 05 11:41:09.567191 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567171 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 05 11:41:09.567191 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567185 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-86sxb\"" Jun 05 11:41:09.567355 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567200 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 05 11:41:09.567514 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.567497 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 05 11:41:09.572342 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.572323 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 05 11:41:09.584371 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.584342 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9f4467c6-drffk"] Jun 05 11:41:09.649694 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649655 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-serving-certs-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.649869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649707 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.649869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.649869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649774 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-metrics-client-ca\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.649869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649854 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.650028 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649896 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.650028 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47n5s\" (UniqueName: \"kubernetes.io/projected/ba3423ed-b03b-460b-b861-2f00c2b700bf-kube-api-access-47n5s\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.650028 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.649948 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-federate-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.750934 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.750896 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.750934 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.750934 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-metrics-client-ca\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.750959 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751094 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751134 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47n5s\" (UniqueName: \"kubernetes.io/projected/ba3423ed-b03b-460b-b861-2f00c2b700bf-kube-api-access-47n5s\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751311 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751162 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-federate-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751311 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751230 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-serving-certs-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751311 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751280 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.751819 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.751763 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-metrics-client-ca\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.752173 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.752152 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-serving-certs-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.752254 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.752144 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-trusted-ca-bundle\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.753710 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.753679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.753873 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.753850 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-telemeter-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.754066 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.754047 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-secret-telemeter-client\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.754104 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.754075 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ba3423ed-b03b-460b-b861-2f00c2b700bf-federate-client-tls\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.759516 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.759491 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47n5s\" (UniqueName: \"kubernetes.io/projected/ba3423ed-b03b-460b-b861-2f00c2b700bf-kube-api-access-47n5s\") pod \"telemeter-client-9f4467c6-drffk\" (UID: \"ba3423ed-b03b-460b-b861-2f00c2b700bf\") " pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:09.873980 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:09.873909 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" Jun 05 11:41:10.028365 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.028260 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-9f4467c6-drffk"] Jun 05 11:41:10.034432 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:10.034391 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba3423ed_b03b_460b_b861_2f00c2b700bf.slice/crio-8cb3362e1f7d49bac8a2bff78ff924422d6ed76db9e8ff3919dc2f9c11a3a52e WatchSource:0}: Error finding container 8cb3362e1f7d49bac8a2bff78ff924422d6ed76db9e8ff3919dc2f9c11a3a52e: Status 404 returned error can't find the container with id 8cb3362e1f7d49bac8a2bff78ff924422d6ed76db9e8ff3919dc2f9c11a3a52e Jun 05 11:41:10.136399 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.136298 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" event={"ID":"ba3423ed-b03b-460b-b861-2f00c2b700bf","Type":"ContainerStarted","Data":"8cb3362e1f7d49bac8a2bff78ff924422d6ed76db9e8ff3919dc2f9c11a3a52e"} Jun 05 11:41:10.628715 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.628679 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:10.631141 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.631121 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.633674 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.633642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 11:41:10.633674 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.633657 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 11:41:10.633888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.633681 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 11:41:10.633888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.633657 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634059 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-95n7t\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634080 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634108 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634115 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634121 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 11:41:10.634203 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634165 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 11:41:10.634727 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634712 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dd1g9jj3jidg\"" Jun 05 11:41:10.634763 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 11:41:10.634867 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.634823 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 11:41:10.635128 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.635113 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 11:41:10.635200 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.635133 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 11:41:10.635200 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.635162 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 11:41:10.636881 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.636861 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 11:41:10.649459 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.649428 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:10.760556 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.760520 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.760556 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.760560 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zl56\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.760584 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761158 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761239 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761386 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761494 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761557 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761588 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761719 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761760 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761822 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.761961 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761952 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.762380 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.761997 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.863773 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.863725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.863957 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.863804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.863957 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.863844 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864096 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.863962 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864096 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.863999 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zl56\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864096 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864033 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864245 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864305 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864305 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864284 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864407 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864338 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864407 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864366 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864415 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864470 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864474 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864836 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864519 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.864836 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864549 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865178 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.865145 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.864547 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.865521 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.865565 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.865594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.865972 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.865944 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.867038 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.867016 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.867846 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.867361 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.868078 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.868053 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.868312 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.868286 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.868452 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.868432 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.869422 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.869379 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.869830 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.869762 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.870043 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.870021 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.870144 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.870113 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.871438 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.871386 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.871544 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.871510 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.872226 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.872204 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.873125 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.873078 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zl56\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.873226 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.873158 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.873226 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.873193 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.873226 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.873199 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:10.942407 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:10.942278 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:11.089943 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:11.089918 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:41:11.092505 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:11.092469 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a4b3c95_8367_467c_977e_85b82e09c273.slice/crio-5dea7ffac55e8b5c64d9f6902db4b9f270b714aa2bf255a090511e9cc1b1d644 WatchSource:0}: Error finding container 5dea7ffac55e8b5c64d9f6902db4b9f270b714aa2bf255a090511e9cc1b1d644: Status 404 returned error can't find the container with id 5dea7ffac55e8b5c64d9f6902db4b9f270b714aa2bf255a090511e9cc1b1d644 Jun 05 11:41:11.141888 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:11.141845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"5dea7ffac55e8b5c64d9f6902db4b9f270b714aa2bf255a090511e9cc1b1d644"} Jun 05 11:41:12.033852 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:12.033747 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8548c45f8c-4f2gm" Jun 05 11:41:12.118889 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:12.118842 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:41:12.149832 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:12.149778 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" event={"ID":"ba3423ed-b03b-460b-b861-2f00c2b700bf","Type":"ContainerStarted","Data":"e2352a15c2a51e5dba9ca96e3b9ad594b512e9176dfa7d2fa0da43e23a2873c7"} Jun 05 11:41:13.154859 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:13.154749 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" exitCode=0 Jun 05 11:41:13.154859 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:13.154829 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} Jun 05 11:41:13.157022 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:13.156993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" event={"ID":"ba3423ed-b03b-460b-b861-2f00c2b700bf","Type":"ContainerStarted","Data":"c4763997f80a906e1ce28cdd896fee82d103297232449d07da7e0348727efcc3"} Jun 05 11:41:13.157128 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:13.157045 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" event={"ID":"ba3423ed-b03b-460b-b861-2f00c2b700bf","Type":"ContainerStarted","Data":"b8559ac8570e3755819802caeeb9b2ee6860e6ebb0ab5670c96f6b9757961a95"} Jun 05 11:41:13.203073 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:13.203017 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-9f4467c6-drffk" podStartSLOduration=1.894825146 podStartE2EDuration="4.203002129s" totalImagesPullingTime="2.308176983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:09 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:13.201544282 +0000 UTC m=+89.895232076" watchObservedRunningTime="2026-06-05 11:41:13.203002129 +0000 UTC m=+89.896689930" Jun 05 11:41:17.175306 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:17.175159 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} Jun 05 11:41:17.175306 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:17.175250 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} Jun 05 11:41:19.185597 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:19.185560 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} Jun 05 11:41:19.185994 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:19.185624 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} Jun 05 11:41:19.185994 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:19.185651 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} Jun 05 11:41:19.185994 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:19.185675 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerStarted","Data":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} Jun 05 11:41:19.213921 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:19.213807 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.481255028 podStartE2EDuration="9.213771723s" totalImagesPullingTime="6.709889178s" totalInitContainerRuntime="22.627517ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:41:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:19.211862064 +0000 UTC m=+95.905549846" watchObservedRunningTime="2026-06-05 11:41:19.213771723 +0000 UTC m=+95.907459529" Jun 05 11:41:20.942635 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:20.942590 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:41:37.148294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.148250 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-754b544cbc-8q9k6" podUID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" containerName="console" containerID="cri-o://303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17" gracePeriod=15 Jun 05 11:41:37.397248 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.397223 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:37.411503 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411452 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411503 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411487 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411506 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411523 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411546 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411583 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29s9b\" (UniqueName: \"kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b\") pod \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\" (UID: \"9d7e30c9-bff7-4760-99bb-3e943d72e7ad\") " Jun 05 11:41:37.411970 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411917 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config" (OuterVolumeSpecName: "console-config") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:41:37.411970 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411925 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:41:37.411970 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.411932 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca" (OuterVolumeSpecName: "service-ca") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:41:37.414422 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.414354 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b" (OuterVolumeSpecName: "kube-api-access-29s9b") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "kube-api-access-29s9b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:41:37.414515 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.414426 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:41:37.414515 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.414443 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9d7e30c9-bff7-4760-99bb-3e943d72e7ad" (UID: "9d7e30c9-bff7-4760-99bb-3e943d72e7ad"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:41:37.513042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513005 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-config\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:37.513042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513036 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-serving-cert\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:37.513042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513046 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-oauth-serving-cert\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:37.513042 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513054 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-service-ca\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:37.513312 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513063 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-console-oauth-config\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:37.513312 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:37.513071 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29s9b\" (UniqueName: \"kubernetes.io/projected/9d7e30c9-bff7-4760-99bb-3e943d72e7ad-kube-api-access-29s9b\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:41:38.255897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.255861 2566 generic.go:356] "Generic (PLEG): container finished" podID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" containerID="303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17" exitCode=0 Jun 05 11:41:38.256308 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.255922 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-754b544cbc-8q9k6" Jun 05 11:41:38.256308 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.255924 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b544cbc-8q9k6" event={"ID":"9d7e30c9-bff7-4760-99bb-3e943d72e7ad","Type":"ContainerDied","Data":"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17"} Jun 05 11:41:38.256308 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.256050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-754b544cbc-8q9k6" event={"ID":"9d7e30c9-bff7-4760-99bb-3e943d72e7ad","Type":"ContainerDied","Data":"3da2a36aea04f90c6ce6401e9f292eae2d667e3b950b57e39dd0f8e9661dba2a"} Jun 05 11:41:38.256881 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.256866 2566 scope.go:117] "RemoveContainer" containerID="303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17" Jun 05 11:41:38.264999 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.264976 2566 scope.go:117] "RemoveContainer" containerID="303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17" Jun 05 11:41:38.265304 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:41:38.265285 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17\": container with ID starting with 303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17 not found: ID does not exist" containerID="303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17" Jun 05 11:41:38.265353 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.265313 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17"} err="failed to get container status \"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17\": rpc error: code = NotFound desc = could not find container \"303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17\": container with ID starting with 303c7c43f5a6244cd2be0ae698c84174f22e3292dd9f0b2fa5b8f0fb74015c17 not found: ID does not exist" Jun 05 11:41:38.273312 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.273289 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:41:38.280000 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:38.279977 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-754b544cbc-8q9k6"] Jun 05 11:41:39.772634 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:39.772597 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" path="/var/lib/kubelet/pods/9d7e30c9-bff7-4760-99bb-3e943d72e7ad/volumes" Jun 05 11:41:53.552375 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.552331 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:41:53.552375 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.552385 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:41:53.555362 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.555341 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 05 11:41:53.556192 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.556177 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 05 11:41:53.565526 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.565500 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4fb895e-e304-4f18-ae1e-d34316ba5ce9-metrics-certs\") pod \"network-metrics-daemon-lls8g\" (UID: \"c4fb895e-e304-4f18-ae1e-d34316ba5ce9\") " pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:41:53.565635 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.565534 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf-original-pull-secret\") pod \"global-pull-secret-syncer-mctkq\" (UID: \"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf\") " pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:41:53.581267 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.581236 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mctkq" Jun 05 11:41:53.591581 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.591550 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-hqqvn\"" Jun 05 11:41:53.599210 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.599187 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lls8g" Jun 05 11:41:53.653492 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.653392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:41:53.656933 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.656859 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 05 11:41:53.666995 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.666975 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 05 11:41:53.677699 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.677673 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgj2m\" (UniqueName: \"kubernetes.io/projected/94becad8-2357-4ffd-a254-0ad3338b7e4c-kube-api-access-tgj2m\") pod \"network-check-target-c6g7h\" (UID: \"94becad8-2357-4ffd-a254-0ad3338b7e4c\") " pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:41:53.724067 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.724036 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mctkq"] Jun 05 11:41:53.727386 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:53.727357 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b71ae8_fa13_47f0_9ab2_c14e9f9c16bf.slice/crio-c315f8525fcd2929c833ef4e22842a32acf8694f1e3c9680dbd2647c847094a2 WatchSource:0}: Error finding container c315f8525fcd2929c833ef4e22842a32acf8694f1e3c9680dbd2647c847094a2: Status 404 returned error can't find the container with id c315f8525fcd2929c833ef4e22842a32acf8694f1e3c9680dbd2647c847094a2 Jun 05 11:41:53.753238 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.753215 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lls8g"] Jun 05 11:41:53.755105 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:53.755081 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4fb895e_e304_4f18_ae1e_d34316ba5ce9.slice/crio-d84ec518dff671415c29378eb31da403978a59b95566b0d1f2ba62ad09a07cef WatchSource:0}: Error finding container d84ec518dff671415c29378eb31da403978a59b95566b0d1f2ba62ad09a07cef: Status 404 returned error can't find the container with id d84ec518dff671415c29378eb31da403978a59b95566b0d1f2ba62ad09a07cef Jun 05 11:41:53.900327 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.900242 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-7949z\"" Jun 05 11:41:53.908470 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:53.908447 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:41:54.043246 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:54.043212 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-c6g7h"] Jun 05 11:41:54.047136 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:41:54.047103 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94becad8_2357_4ffd_a254_0ad3338b7e4c.slice/crio-f8647f8e6a42ef714b26fdf9d9f6b4ed78283402b357565f775eae668428dc82 WatchSource:0}: Error finding container f8647f8e6a42ef714b26fdf9d9f6b4ed78283402b357565f775eae668428dc82: Status 404 returned error can't find the container with id f8647f8e6a42ef714b26fdf9d9f6b4ed78283402b357565f775eae668428dc82 Jun 05 11:41:54.316925 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:54.316882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lls8g" event={"ID":"c4fb895e-e304-4f18-ae1e-d34316ba5ce9","Type":"ContainerStarted","Data":"d84ec518dff671415c29378eb31da403978a59b95566b0d1f2ba62ad09a07cef"} Jun 05 11:41:54.318059 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:54.318020 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mctkq" event={"ID":"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf","Type":"ContainerStarted","Data":"c315f8525fcd2929c833ef4e22842a32acf8694f1e3c9680dbd2647c847094a2"} Jun 05 11:41:54.319223 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:54.319196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c6g7h" event={"ID":"94becad8-2357-4ffd-a254-0ad3338b7e4c","Type":"ContainerStarted","Data":"f8647f8e6a42ef714b26fdf9d9f6b4ed78283402b357565f775eae668428dc82"} Jun 05 11:41:55.326369 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:55.326322 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lls8g" event={"ID":"c4fb895e-e304-4f18-ae1e-d34316ba5ce9","Type":"ContainerStarted","Data":"7ec849d426e057a4fee2abf009373c89452c183eb69795a9258e8e31b4354555"} Jun 05 11:41:55.326849 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:55.326395 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lls8g" event={"ID":"c4fb895e-e304-4f18-ae1e-d34316ba5ce9","Type":"ContainerStarted","Data":"ad6ca77e61b8ec45f6fa74be482e91082219916d4a1f9dc7c6d296b3f93887fb"} Jun 05 11:41:55.345868 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:55.345804 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lls8g" podStartSLOduration=131.474448988 podStartE2EDuration="2m12.345765711s" totalImagesPullingTime="871.316723ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:55.344085294 +0000 UTC m=+132.037773076" watchObservedRunningTime="2026-06-05 11:41:55.345765711 +0000 UTC m=+132.039453494" Jun 05 11:41:59.345448 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:59.345403 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mctkq" event={"ID":"24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf","Type":"ContainerStarted","Data":"5cd7b61e9b2ea9ac7e1cf4b97691d3af4528aec9df888d14ac4f5e70c5dc3470"} Jun 05 11:41:59.346901 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:59.346873 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-c6g7h" event={"ID":"94becad8-2357-4ffd-a254-0ad3338b7e4c","Type":"ContainerStarted","Data":"3ec85d1aec1fa8720ae8c71ab8b54b5015f15e15a097e426fbec0c9df17abb29"} Jun 05 11:41:59.347015 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:59.346998 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:41:59.362996 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:59.362942 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mctkq" podStartSLOduration=131.437387082 podStartE2EDuration="2m16.362928518s" totalImagesPullingTime="4.925541436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:59.36231913 +0000 UTC m=+136.056006912" watchObservedRunningTime="2026-06-05 11:41:59.362928518 +0000 UTC m=+136.056616299" Jun 05 11:41:59.382464 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:41:59.382413 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-c6g7h" podStartSLOduration=131.780826084 podStartE2EDuration="2m16.38239863s" totalImagesPullingTime="4.601572546s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:39:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:41:59.382012399 +0000 UTC m=+136.075700193" watchObservedRunningTime="2026-06-05 11:41:59.38239863 +0000 UTC m=+136.076086412" Jun 05 11:42:10.942884 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:10.942835 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:10.963831 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:10.963802 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:11.406265 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:11.406224 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.073427 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073394 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073705 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="prometheus" containerID="cri-o://385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" gracePeriod=600 Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073725 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy" containerID="cri-o://11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" gracePeriod=600 Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073783 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" gracePeriod=600 Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073807 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="config-reloader" containerID="cri-o://2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" gracePeriod=600 Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073755 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="thanos-sidecar" containerID="cri-o://0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" gracePeriod=600 Jun 05 11:42:29.074005 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.073746 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-web" containerID="cri-o://d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" gracePeriod=600 Jun 05 11:42:29.313731 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.313696 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.342286 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342205 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342286 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342241 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342286 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342263 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342287 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342307 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342326 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342346 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342373 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342396 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342419 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342451 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342479 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342509 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.342555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342542 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342583 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342609 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342644 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342686 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342723 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.343291 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342758 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zl56\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56\") pod \"5a4b3c95-8367-467c-977e-85b82e09c273\" (UID: \"5a4b3c95-8367-467c-977e-85b82e09c273\") " Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.342680 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.344651 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.344299 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.344630 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.344824 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.345547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.345491 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.347877 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.345958 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:42:29.347877 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.346335 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 05 11:42:29.347877 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.347027 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.348909 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.348661 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.349269 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.349225 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.349467 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.349436 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.349593 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.349573 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56" (OuterVolumeSpecName: "kube-api-access-9zl56") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "kube-api-access-9zl56". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:42:29.350309 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.350155 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.350309 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.350243 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out" (OuterVolumeSpecName: "config-out") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:42:29.350474 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.350341 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.350530 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.350472 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.351294 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.351274 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config" (OuterVolumeSpecName: "config") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.351525 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.351512 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:42:29.360409 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.360379 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config" (OuterVolumeSpecName: "web-config") pod "5a4b3c95-8367-467c-977e-85b82e09c273" (UID: "5a4b3c95-8367-467c-977e-85b82e09c273"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 05 11:42:29.443414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443363 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443406 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zl56\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-kube-api-access-9zl56\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443419 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443430 2566 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-metrics-client-certs\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443440 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443449 2566 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443458 2566 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-web-config\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443467 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-db\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443475 2566 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a4b3c95-8367-467c-977e-85b82e09c273-config-out\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443483 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-metrics-client-ca\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443490 2566 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a4b3c95-8367-467c-977e-85b82e09c273-tls-assets\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443498 2566 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-kube-rbac-proxy\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443506 2566 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-secret-grpc-tls\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443514 2566 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443521 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443529 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443537 2566 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a4b3c95-8367-467c-977e-85b82e09c273-config\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443545 2566 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443553 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.443676 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.443561 2566 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a4b3c95-8367-467c-977e-85b82e09c273-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:42:29.468449 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468406 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" exitCode=0 Jun 05 11:42:29.468449 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468443 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" exitCode=0 Jun 05 11:42:29.468449 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468452 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" exitCode=0 Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468460 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" exitCode=0 Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468467 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" exitCode=0 Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468475 2566 generic.go:356] "Generic (PLEG): container finished" podID="5a4b3c95-8367-467c-977e-85b82e09c273" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" exitCode=0 Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468461 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468517 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468574 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468605 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468637 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468649 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468675 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} Jun 05 11:42:29.468736 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468713 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} Jun 05 11:42:29.469251 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.468754 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a4b3c95-8367-467c-977e-85b82e09c273","Type":"ContainerDied","Data":"5dea7ffac55e8b5c64d9f6902db4b9f270b714aa2bf255a090511e9cc1b1d644"} Jun 05 11:42:29.477467 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.477449 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.485037 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.485021 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.491782 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.491758 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.493895 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.493878 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:29.499067 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.499045 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:29.499863 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.499849 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.508062 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.508013 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.515981 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.515964 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.522990 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.522974 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.523245 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.523229 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.523302 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523253 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.523302 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523272 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.523527 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.523512 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.523569 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523530 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.523569 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523545 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.523881 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.523859 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.523968 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523889 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.523968 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.523914 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.524279 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.524263 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.524323 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524283 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.524323 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524296 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.524542 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.524524 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.524583 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524548 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.524583 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524562 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.524820 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.524782 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.524877 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524824 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.524877 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.524838 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.525019 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:42:29.525004 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.525054 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525022 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.525054 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525034 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.525199 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525182 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.525240 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525201 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.525365 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525349 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.525405 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525365 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.525526 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525511 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.525526 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525524 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.525716 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525703 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.525752 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525716 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.525936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525921 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.525977 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.525937 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.526135 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526120 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.526170 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526134 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.526299 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526285 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.526339 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526298 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.526467 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526454 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.526501 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526468 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.526647 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526631 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.526684 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526649 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.526849 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526836 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.526891 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.526849 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.527041 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527026 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.527076 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527041 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.527228 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527213 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.527265 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527228 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.527409 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527396 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.527448 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527410 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.527593 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527579 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.527631 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527594 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.527806 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527776 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.527855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527808 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.527988 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527972 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.528026 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.527990 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.528189 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528166 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.528229 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528191 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.528382 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528367 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.528433 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528382 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.528584 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528570 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.528620 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528584 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.528769 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528752 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.528834 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528768 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.528964 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528948 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.528964 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.528963 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.529120 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529107 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.529120 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529120 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.529284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529270 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.529284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529282 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.529468 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529449 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.529516 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529469 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.529660 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529646 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.529660 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529659 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.529845 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529831 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.529845 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.529844 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.530022 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530007 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.530062 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530022 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.530211 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530196 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.530251 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530211 2566 scope.go:117] "RemoveContainer" containerID="8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d" Jun 05 11:42:29.530389 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530374 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d"} err="failed to get container status \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": rpc error: code = NotFound desc = could not find container \"8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d\": container with ID starting with 8d3155646238a5a74d0d0eecb422cddcff21b3e44e57019918d9321f3b03e54d not found: ID does not exist" Jun 05 11:42:29.530429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530389 2566 scope.go:117] "RemoveContainer" containerID="11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862" Jun 05 11:42:29.530547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530534 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862"} err="failed to get container status \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": rpc error: code = NotFound desc = could not find container \"11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862\": container with ID starting with 11aa167b882041f928d3c257e03d68e9ed877d2da8dea999751709ecac7ca862 not found: ID does not exist" Jun 05 11:42:29.530547 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530546 2566 scope.go:117] "RemoveContainer" containerID="d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660" Jun 05 11:42:29.530725 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530707 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660"} err="failed to get container status \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": rpc error: code = NotFound desc = could not find container \"d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660\": container with ID starting with d0b4bba080d2e1b486e53ee485c3af96a292f557276b661cbcca95d4a34a7660 not found: ID does not exist" Jun 05 11:42:29.530767 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530727 2566 scope.go:117] "RemoveContainer" containerID="0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9" Jun 05 11:42:29.530981 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530953 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9"} err="failed to get container status \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": rpc error: code = NotFound desc = could not find container \"0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9\": container with ID starting with 0028b2b8b42fee751963986fda259f3b21a3ad4836f4fa0de4603a4cb4c0a9b9 not found: ID does not exist" Jun 05 11:42:29.530981 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.530981 2566 scope.go:117] "RemoveContainer" containerID="2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647" Jun 05 11:42:29.531307 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.531281 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647"} err="failed to get container status \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": rpc error: code = NotFound desc = could not find container \"2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647\": container with ID starting with 2334cc1060747d9ea7365776d5e32c2eb58d5c3c72a83c2a43004181e1261647 not found: ID does not exist" Jun 05 11:42:29.531381 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.531310 2566 scope.go:117] "RemoveContainer" containerID="385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5" Jun 05 11:42:29.531565 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.531548 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5"} err="failed to get container status \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": rpc error: code = NotFound desc = could not find container \"385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5\": container with ID starting with 385cd6bcabc1e5f414aed704359b4b36f1d82bbc8f1a64d6cffa5d07b601cae5 not found: ID does not exist" Jun 05 11:42:29.531565 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.531565 2566 scope.go:117] "RemoveContainer" containerID="f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d" Jun 05 11:42:29.531763 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.531743 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d"} err="failed to get container status \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": rpc error: code = NotFound desc = could not find container \"f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d\": container with ID starting with f14f232480206698bdb4b50f8a246cb79ffc742df0f43546b0810e2741e3de8d not found: ID does not exist" Jun 05 11:42:29.532906 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.532884 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:29.533155 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533142 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-web" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533158 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-web" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533168 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533174 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533184 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="prometheus" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533189 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="prometheus" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533196 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="thanos-sidecar" Jun 05 11:42:29.533198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533200 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="thanos-sidecar" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533208 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-thanos" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533213 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-thanos" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533220 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="init-config-reloader" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533225 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="init-config-reloader" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533231 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="config-reloader" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533236 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="config-reloader" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533246 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" containerName="console" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533252 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" containerName="console" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533298 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-web" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533305 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="config-reloader" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533312 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="prometheus" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533319 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy-thanos" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533325 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d7e30c9-bff7-4760-99bb-3e943d72e7ad" containerName="console" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533330 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="thanos-sidecar" Jun 05 11:42:29.533408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.533336 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" containerName="kube-rbac-proxy" Jun 05 11:42:29.536869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.536852 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.539483 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.539465 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 05 11:42:29.539586 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.539557 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 05 11:42:29.543440 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.543415 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 05 11:42:29.543537 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.543469 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 05 11:42:29.543596 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.543411 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 05 11:42:29.543667 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.543652 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 05 11:42:29.544299 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544390 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544390 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544341 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544390 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544373 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544393 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544414 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544484 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544510 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544532 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544550 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544615 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544690 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544717 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544734 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544812 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544833 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544851 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf92c\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-kube-api-access-qf92c\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.544936 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.544915 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.545400 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545046 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 05 11:42:29.545400 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545347 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 05 11:42:29.545496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545470 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 05 11:42:29.545766 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545741 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 05 11:42:29.545872 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545741 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 05 11:42:29.545872 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.545778 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 05 11:42:29.546747 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.546727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 05 11:42:29.546747 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.546749 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-95n7t\"" Jun 05 11:42:29.546913 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.546847 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dd1g9jj3jidg\"" Jun 05 11:42:29.546913 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.546863 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 05 11:42:29.552029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.552009 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 05 11:42:29.556723 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.556704 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:29.646098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646047 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646067 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646083 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf92c\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-kube-api-access-qf92c\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646105 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646160 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646220 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646248 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646275 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646302 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646322 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646343 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646364 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.646414 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646423 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646451 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646479 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646511 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647029 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.646817 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647317 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.647293 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.647428 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.647404 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.648879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.647809 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.648879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.648397 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.648879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.648644 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.648879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.648868 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.649953 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.650318 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b0089893-e2dd-4bc4-9831-4a14fda6107f-config-out\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650429 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.650372 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650650 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.650467 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650650 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.650492 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.650926 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.650905 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.651394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.651369 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.651703 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.651679 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-web-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.651925 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.651906 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.652109 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.652090 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b0089893-e2dd-4bc4-9831-4a14fda6107f-config\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.652243 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.652222 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.652635 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.652618 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b0089893-e2dd-4bc4-9831-4a14fda6107f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.654528 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.654508 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf92c\" (UniqueName: \"kubernetes.io/projected/b0089893-e2dd-4bc4-9831-4a14fda6107f-kube-api-access-qf92c\") pod \"prometheus-k8s-0\" (UID: \"b0089893-e2dd-4bc4-9831-4a14fda6107f\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.772762 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.772727 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a4b3c95-8367-467c-977e-85b82e09c273" path="/var/lib/kubelet/pods/5a4b3c95-8367-467c-977e-85b82e09c273/volumes" Jun 05 11:42:29.846182 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.846151 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:42:29.999487 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:29.999446 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 05 11:42:30.003749 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:42:30.003723 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0089893_e2dd_4bc4_9831_4a14fda6107f.slice/crio-5686a66eea3f92671596dc91f31a244eb88b8b270ea03aa1ce896444fb4ee990 WatchSource:0}: Error finding container 5686a66eea3f92671596dc91f31a244eb88b8b270ea03aa1ce896444fb4ee990: Status 404 returned error can't find the container with id 5686a66eea3f92671596dc91f31a244eb88b8b270ea03aa1ce896444fb4ee990 Jun 05 11:42:30.353273 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:30.353238 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-c6g7h" Jun 05 11:42:30.473218 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:30.473186 2566 generic.go:356] "Generic (PLEG): container finished" podID="b0089893-e2dd-4bc4-9831-4a14fda6107f" containerID="ef87c35c939449b8497986fb1cbc61de908f95e4633bbce5942c532be71139b5" exitCode=0 Jun 05 11:42:30.473376 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:30.473270 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerDied","Data":"ef87c35c939449b8497986fb1cbc61de908f95e4633bbce5942c532be71139b5"} Jun 05 11:42:30.473376 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:30.473333 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"5686a66eea3f92671596dc91f31a244eb88b8b270ea03aa1ce896444fb4ee990"} Jun 05 11:42:31.481426 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481385 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"084f4d022c5a5aeed77126dc560a433805956ea0daefe9f12f1740cda2cc98bd"} Jun 05 11:42:31.481855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481504 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"cc7a353526d99a63923cfd6d2a888b16031244fd75d363c6b4fdb8cb506618cf"} Jun 05 11:42:31.481855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481547 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"dcdf51f085611b90b8f464eb0c93265c003325f8b71bcfe7135f8825fd398981"} Jun 05 11:42:31.481855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481584 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"7267d415d837569d86d3e68fcd6fb4fef009bf36447b02c72e0de46277d25dae"} Jun 05 11:42:31.481855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"36c667d7f3dda1f9d9038706f35b2f7f28dfff8d466a68610c5a30c664c6b2c4"} Jun 05 11:42:31.481855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.481653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b0089893-e2dd-4bc4-9831-4a14fda6107f","Type":"ContainerStarted","Data":"944ebdbdd3fdd2e17ff53ec9224f6cdf441845053e392a7aae3e9868d94fe8c5"} Jun 05 11:42:31.517265 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:31.517200 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.496925632 podStartE2EDuration="2.517179495s" totalImagesPullingTime="0s" totalInitContainerRuntime="20.253863ms" isStatefulPod=false podCreationTimestamp="2026-06-05 11:42:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:42:31.515370529 +0000 UTC m=+168.209058311" watchObservedRunningTime="2026-06-05 11:42:31.517179495 +0000 UTC m=+168.210867283" Jun 05 11:42:34.847278 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:42:34.847229 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:29.846348 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:43:29.846312 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:29.862358 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:43:29.862334 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:43:30.717067 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:43:30.717041 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 05 11:44:43.712143 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:44:43.712117 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:44:43.714172 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:44:43.714149 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:44:43.720279 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:44:43.720257 2566 kubelet.go:1648] "Image garbage collection succeeded" Jun 05 11:45:46.333807 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.333749 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm"] Jun 05 11:45:46.336927 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.336906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.339416 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.339393 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jun 05 11:45:46.340476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.340457 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jun 05 11:45:46.340476 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.340464 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-vhtkk\"" Jun 05 11:45:46.346332 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.346307 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm"] Jun 05 11:45:46.459647 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.459605 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qf44n\" (UniqueName: \"kubernetes.io/projected/deab553c-a03f-4f66-bbdb-418ce6e304cc-kube-api-access-qf44n\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.459647 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.459649 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deab553c-a03f-4f66-bbdb-418ce6e304cc-tmp\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.560922 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.560875 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qf44n\" (UniqueName: \"kubernetes.io/projected/deab553c-a03f-4f66-bbdb-418ce6e304cc-kube-api-access-qf44n\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.560922 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.560925 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deab553c-a03f-4f66-bbdb-418ce6e304cc-tmp\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.561394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.561374 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/deab553c-a03f-4f66-bbdb-418ce6e304cc-tmp\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.570578 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.570548 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qf44n\" (UniqueName: \"kubernetes.io/projected/deab553c-a03f-4f66-bbdb-418ce6e304cc-kube-api-access-qf44n\") pod \"jobset-operator-5bc45f897-gxqqm\" (UID: \"deab553c-a03f-4f66-bbdb-418ce6e304cc\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.652953 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.652865 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" Jun 05 11:45:46.787239 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.787207 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm"] Jun 05 11:45:46.790651 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:45:46.790626 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddeab553c_a03f_4f66_bbdb_418ce6e304cc.slice/crio-b3105cf78a6e44dd7dce99c0b2d9157e6cc4abd49a5a1350d781f0f28fa9d726 WatchSource:0}: Error finding container b3105cf78a6e44dd7dce99c0b2d9157e6cc4abd49a5a1350d781f0f28fa9d726: Status 404 returned error can't find the container with id b3105cf78a6e44dd7dce99c0b2d9157e6cc4abd49a5a1350d781f0f28fa9d726 Jun 05 11:45:46.792128 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:46.792110 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 11:45:47.172124 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:47.172080 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" event={"ID":"deab553c-a03f-4f66-bbdb-418ce6e304cc","Type":"ContainerStarted","Data":"b3105cf78a6e44dd7dce99c0b2d9157e6cc4abd49a5a1350d781f0f28fa9d726"} Jun 05 11:45:50.185060 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:50.184950 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" event={"ID":"deab553c-a03f-4f66-bbdb-418ce6e304cc","Type":"ContainerStarted","Data":"62ab751af2f89d31203c61de7500047bc73a85545383fbe8be8070434cec9016"} Jun 05 11:45:50.206855 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:45:50.206805 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-gxqqm" podStartSLOduration=1.103091039 podStartE2EDuration="4.206770258s" totalImagesPullingTime="3.103679219s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:45:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:45:50.204004375 +0000 UTC m=+366.897692155" watchObservedRunningTime="2026-06-05 11:45:50.206770258 +0000 UTC m=+366.900458039" Jun 05 11:46:16.583698 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.583661 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq"] Jun 05 11:46:16.586831 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.586812 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.589671 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.589647 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 05 11:46:16.589807 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.589679 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 05 11:46:16.590702 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.590682 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 05 11:46:16.590702 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.590694 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 05 11:46:16.590879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.590682 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-25nsm\"" Jun 05 11:46:16.596959 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.596939 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq"] Jun 05 11:46:16.719269 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.719233 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bz7dg\" (UniqueName: \"kubernetes.io/projected/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kube-api-access-bz7dg\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.719435 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.719293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.719435 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.719362 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-cert\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.820217 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.820173 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-cert\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.820217 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.820223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bz7dg\" (UniqueName: \"kubernetes.io/projected/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kube-api-access-bz7dg\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.820433 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.820267 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.820935 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.820916 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.822686 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.822655 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-cert\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.830613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.830588 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bz7dg\" (UniqueName: \"kubernetes.io/projected/86ba3750-b073-4d2a-85e3-23d8ca90c8f4-kube-api-access-bz7dg\") pod \"kubeflow-trainer-controller-manager-76ccd4d998-9skzq\" (UID: \"86ba3750-b073-4d2a-85e3-23d8ca90c8f4\") " pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:16.896639 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:16.896528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:17.040250 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:17.040215 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq"] Jun 05 11:46:17.043213 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:46:17.043185 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86ba3750_b073_4d2a_85e3_23d8ca90c8f4.slice/crio-9e5f1ff23accd73dc3521560b529e6872494f72c489a8253225b19a7c0c4c05a WatchSource:0}: Error finding container 9e5f1ff23accd73dc3521560b529e6872494f72c489a8253225b19a7c0c4c05a: Status 404 returned error can't find the container with id 9e5f1ff23accd73dc3521560b529e6872494f72c489a8253225b19a7c0c4c05a Jun 05 11:46:17.291326 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:17.291289 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" event={"ID":"86ba3750-b073-4d2a-85e3-23d8ca90c8f4","Type":"ContainerStarted","Data":"9e5f1ff23accd73dc3521560b529e6872494f72c489a8253225b19a7c0c4c05a"} Jun 05 11:46:20.305017 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:20.304977 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" event={"ID":"86ba3750-b073-4d2a-85e3-23d8ca90c8f4","Type":"ContainerStarted","Data":"08e0f3afbfcc074a310cf123e3dba8a26b8f5899142eb95776f556a20d746ebd"} Jun 05 11:46:20.305415 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:20.305044 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:46:20.325192 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:20.325140 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" podStartSLOduration=2.040896157 podStartE2EDuration="4.325123827s" totalImagesPullingTime="2.28422767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:46:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:46:20.32283776 +0000 UTC m=+397.016525542" watchObservedRunningTime="2026-06-05 11:46:20.325123827 +0000 UTC m=+397.018811607" Jun 05 11:46:36.314226 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:46:36.314192 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-76ccd4d998-9skzq" Jun 05 11:48:11.103723 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.103678 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl"] Jun 05 11:48:11.106988 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.106970 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:48:11.109869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.109847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"openshift-service-ca.crt\"" Jun 05 11:48:11.109992 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.109847 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"kube-root-ca.crt\"" Jun 05 11:48:11.110866 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.110847 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"default-dockercfg-9w5g7\"" Jun 05 11:48:11.118120 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.118097 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl"] Jun 05 11:48:11.175968 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.175919 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhhr7\" (UniqueName: \"kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7\") pod \"progression-enabled-node-0-0-p79fl\" (UID: \"fa8fe9e3-6b28-44ff-a332-17b52000ac42\") " pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:48:11.281678 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.281640 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhhr7\" (UniqueName: \"kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7\") pod \"progression-enabled-node-0-0-p79fl\" (UID: \"fa8fe9e3-6b28-44ff-a332-17b52000ac42\") " pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:48:11.290752 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.290716 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhhr7\" (UniqueName: \"kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7\") pod \"progression-enabled-node-0-0-p79fl\" (UID: \"fa8fe9e3-6b28-44ff-a332-17b52000ac42\") " pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:48:11.417911 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.417825 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:48:11.557869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.557844 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl"] Jun 05 11:48:11.560484 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:48:11.560454 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa8fe9e3_6b28_44ff_a332_17b52000ac42.slice/crio-81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c WatchSource:0}: Error finding container 81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c: Status 404 returned error can't find the container with id 81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c Jun 05 11:48:11.712554 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:48:11.712523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" event={"ID":"fa8fe9e3-6b28-44ff-a332-17b52000ac42","Type":"ContainerStarted","Data":"81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c"} Jun 05 11:50:10.311354 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:10.311262 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:50:10.312396 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:10.312362 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:50:11.212019 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:11.211925 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" event={"ID":"fa8fe9e3-6b28-44ff-a332-17b52000ac42","Type":"ContainerStarted","Data":"eaea9d1dba4249e8f2cb89e8844c6808e4d6c5e5bdeaeeb3cfebeb22e3c91491"} Jun 05 11:50:11.212191 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:11.212074 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:50:11.249906 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:11.249841 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" podStartSLOduration=0.91659242 podStartE2EDuration="2m0.249818659s" totalImagesPullingTime="1m59.333226239s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:48:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:50:11.246171801 +0000 UTC m=+627.939859580" watchObservedRunningTime="2026-06-05 11:50:11.249818659 +0000 UTC m=+627.943506435" Jun 05 11:50:13.219828 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:13.219784 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:50:34.253330 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:34.217153 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" podUID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" containerName="node" probeResult="failure" output="Get \"http://10.133.0.18:28080/metrics\": dial tcp 10.133.0.18:28080: connect: connection refused" Jun 05 11:50:34.301235 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:34.301199 2566 generic.go:356] "Generic (PLEG): container finished" podID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" containerID="eaea9d1dba4249e8f2cb89e8844c6808e4d6c5e5bdeaeeb3cfebeb22e3c91491" exitCode=0 Jun 05 11:50:34.301392 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:34.301258 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" event={"ID":"fa8fe9e3-6b28-44ff-a332-17b52000ac42","Type":"ContainerDied","Data":"eaea9d1dba4249e8f2cb89e8844c6808e4d6c5e5bdeaeeb3cfebeb22e3c91491"} Jun 05 11:50:35.455197 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:35.455159 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:50:35.555284 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:35.555187 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhhr7\" (UniqueName: \"kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7\") pod \"fa8fe9e3-6b28-44ff-a332-17b52000ac42\" (UID: \"fa8fe9e3-6b28-44ff-a332-17b52000ac42\") " Jun 05 11:50:35.557613 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:35.557582 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7" (OuterVolumeSpecName: "kube-api-access-xhhr7") pod "fa8fe9e3-6b28-44ff-a332-17b52000ac42" (UID: "fa8fe9e3-6b28-44ff-a332-17b52000ac42"). InnerVolumeSpecName "kube-api-access-xhhr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:50:35.656012 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:35.655971 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhhr7\" (UniqueName: \"kubernetes.io/projected/fa8fe9e3-6b28-44ff-a332-17b52000ac42-kube-api-access-xhhr7\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:50:36.310658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:36.310630 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" Jun 05 11:50:36.310863 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:36.310628 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl" event={"ID":"fa8fe9e3-6b28-44ff-a332-17b52000ac42","Type":"ContainerDied","Data":"81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c"} Jun 05 11:50:36.310863 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:36.310766 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e9b62dea51db80ef62d7a05c416a2e21b1f4a22eff8312c09cf8b3c7181f1c" Jun 05 11:50:37.712161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.712114 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9"] Jun 05 11:50:37.712582 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.712420 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" containerName="node" Jun 05 11:50:37.712582 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.712432 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" containerName="node" Jun 05 11:50:37.712582 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.712489 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" containerName="node" Jun 05 11:50:37.730766 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.730735 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9"] Jun 05 11:50:37.730966 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.730855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:37.733537 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.733499 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"default-dockercfg-9w5g7\"" Jun 05 11:50:37.733537 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.733529 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"kube-root-ca.crt\"" Jun 05 11:50:37.733734 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.733547 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"openshift-service-ca.crt\"" Jun 05 11:50:37.770125 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.770096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9x6v\" (UniqueName: \"kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v\") pod \"progression-disabled-node-0-0-gb6k9\" (UID: \"d2b1b886-6037-4a92-a127-de5df9036a84\") " pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:37.870621 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.870580 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9x6v\" (UniqueName: \"kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v\") pod \"progression-disabled-node-0-0-gb6k9\" (UID: \"d2b1b886-6037-4a92-a127-de5df9036a84\") " pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:37.880411 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:37.880375 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9x6v\" (UniqueName: \"kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v\") pod \"progression-disabled-node-0-0-gb6k9\" (UID: \"d2b1b886-6037-4a92-a127-de5df9036a84\") " pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:38.040545 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:38.040506 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:38.196627 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:38.196597 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9"] Jun 05 11:50:38.199998 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:50:38.199966 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2b1b886_6037_4a92_a127_de5df9036a84.slice/crio-ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e WatchSource:0}: Error finding container ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e: Status 404 returned error can't find the container with id ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e Jun 05 11:50:38.319879 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:38.319845 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" event={"ID":"d2b1b886-6037-4a92-a127-de5df9036a84","Type":"ContainerStarted","Data":"ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e"} Jun 05 11:50:39.326099 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:39.326056 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" event={"ID":"d2b1b886-6037-4a92-a127-de5df9036a84","Type":"ContainerStarted","Data":"59145ae840d79a64269ccd703257dba6a0969ebebd9e0b31c3061905653db6d4"} Jun 05 11:50:39.326529 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:39.326174 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:50:39.345383 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:39.345321 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" podStartSLOduration=2.345298857 podStartE2EDuration="2.345298857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:50:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:50:39.343920161 +0000 UTC m=+656.037607944" watchObservedRunningTime="2026-06-05 11:50:39.345298857 +0000 UTC m=+656.038986639" Jun 05 11:50:40.329014 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:50:40.328984 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:51:01.505362 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:01.505313 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" probeResult="failure" output="Get \"http://10.133.0.19:28080/metrics\": read tcp 10.133.0.2:43932->10.133.0.19:28080: read: connection reset by peer" Jun 05 11:51:02.327024 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:02.326976 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" probeResult="failure" output="Get \"http://10.133.0.19:28080/metrics\": dial tcp 10.133.0.19:28080: connect: connection refused" Jun 05 11:51:02.327202 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:02.327100 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:51:02.327574 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:02.327549 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" probeResult="failure" output="Get \"http://10.133.0.19:28080/metrics\": dial tcp 10.133.0.19:28080: connect: connection refused" Jun 05 11:51:02.418694 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:02.418656 2566 generic.go:356] "Generic (PLEG): container finished" podID="d2b1b886-6037-4a92-a127-de5df9036a84" containerID="59145ae840d79a64269ccd703257dba6a0969ebebd9e0b31c3061905653db6d4" exitCode=0 Jun 05 11:51:02.418960 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:02.418738 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" event={"ID":"d2b1b886-6037-4a92-a127-de5df9036a84","Type":"ContainerDied","Data":"59145ae840d79a64269ccd703257dba6a0969ebebd9e0b31c3061905653db6d4"} Jun 05 11:51:03.557521 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:03.557492 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:51:03.684524 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:03.684425 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9x6v\" (UniqueName: \"kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v\") pod \"d2b1b886-6037-4a92-a127-de5df9036a84\" (UID: \"d2b1b886-6037-4a92-a127-de5df9036a84\") " Jun 05 11:51:03.686755 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:03.686731 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v" (OuterVolumeSpecName: "kube-api-access-x9x6v") pod "d2b1b886-6037-4a92-a127-de5df9036a84" (UID: "d2b1b886-6037-4a92-a127-de5df9036a84"). InnerVolumeSpecName "kube-api-access-x9x6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:51:03.785846 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:03.785819 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9x6v\" (UniqueName: \"kubernetes.io/projected/d2b1b886-6037-4a92-a127-de5df9036a84-kube-api-access-x9x6v\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:51:04.427645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:04.427609 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" Jun 05 11:51:04.427645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:04.427622 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9" event={"ID":"d2b1b886-6037-4a92-a127-de5df9036a84","Type":"ContainerDied","Data":"ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e"} Jun 05 11:51:04.427903 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:04.427674 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ce8f3cea6dae5c1619b6e1a37fc439aa301cefab2c6378dfa59100fdc3f4594e" Jun 05 11:51:12.725916 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.725875 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj"] Jun 05 11:51:12.726430 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.726191 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" Jun 05 11:51:12.726430 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.726203 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" Jun 05 11:51:12.726430 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.726263 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" containerName="node" Jun 05 11:51:12.729225 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.729206 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:12.731980 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.731945 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"openshift-service-ca.crt\"" Jun 05 11:51:12.731980 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.731970 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"default-dockercfg-9w5g7\"" Jun 05 11:51:12.732952 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.732934 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"kube-root-ca.crt\"" Jun 05 11:51:12.741929 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.741904 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj"] Jun 05 11:51:12.865834 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.865759 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clsk6\" (UniqueName: \"kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6\") pod \"progression-invalid-node-0-0-5b5vj\" (UID: \"9f46c902-cf6f-44ab-b23e-94947d860055\") " pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:12.966800 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.966759 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clsk6\" (UniqueName: \"kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6\") pod \"progression-invalid-node-0-0-5b5vj\" (UID: \"9f46c902-cf6f-44ab-b23e-94947d860055\") " pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:12.977643 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:12.977571 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clsk6\" (UniqueName: \"kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6\") pod \"progression-invalid-node-0-0-5b5vj\" (UID: \"9f46c902-cf6f-44ab-b23e-94947d860055\") " pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:13.038249 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.038210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:13.176198 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.176164 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj"] Jun 05 11:51:13.179674 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:51:13.179646 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f46c902_cf6f_44ab_b23e_94947d860055.slice/crio-9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed WatchSource:0}: Error finding container 9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed: Status 404 returned error can't find the container with id 9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed Jun 05 11:51:13.466060 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.466028 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" event={"ID":"9f46c902-cf6f-44ab-b23e-94947d860055","Type":"ContainerStarted","Data":"86620ed0c3d49384521f2cc3694aaa48091e898ca68b9161e4c2fa12224a5787"} Jun 05 11:51:13.466263 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.466076 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" event={"ID":"9f46c902-cf6f-44ab-b23e-94947d860055","Type":"ContainerStarted","Data":"9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed"} Jun 05 11:51:13.466263 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.466176 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:13.488367 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:13.488266 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" podStartSLOduration=1.488250324 podStartE2EDuration="1.488250324s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:51:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:51:13.486002751 +0000 UTC m=+690.179690542" watchObservedRunningTime="2026-06-05 11:51:13.488250324 +0000 UTC m=+690.181938105" Jun 05 11:51:15.473240 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:15.473209 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:36.470813 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:36.470750 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" podUID="9f46c902-cf6f-44ab-b23e-94947d860055" containerName="node" probeResult="failure" output="Get \"http://10.133.0.20:28080/metrics\": dial tcp 10.133.0.20:28080: connect: connection refused" Jun 05 11:51:36.556749 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:36.556716 2566 generic.go:356] "Generic (PLEG): container finished" podID="9f46c902-cf6f-44ab-b23e-94947d860055" containerID="86620ed0c3d49384521f2cc3694aaa48091e898ca68b9161e4c2fa12224a5787" exitCode=0 Jun 05 11:51:36.556958 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:36.556816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" event={"ID":"9f46c902-cf6f-44ab-b23e-94947d860055","Type":"ContainerDied","Data":"86620ed0c3d49384521f2cc3694aaa48091e898ca68b9161e4c2fa12224a5787"} Jun 05 11:51:37.699389 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:37.699363 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:37.780137 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:37.780101 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clsk6\" (UniqueName: \"kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6\") pod \"9f46c902-cf6f-44ab-b23e-94947d860055\" (UID: \"9f46c902-cf6f-44ab-b23e-94947d860055\") " Jun 05 11:51:37.782333 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:37.782306 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6" (OuterVolumeSpecName: "kube-api-access-clsk6") pod "9f46c902-cf6f-44ab-b23e-94947d860055" (UID: "9f46c902-cf6f-44ab-b23e-94947d860055"). InnerVolumeSpecName "kube-api-access-clsk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:51:37.881533 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:37.881446 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clsk6\" (UniqueName: \"kubernetes.io/projected/9f46c902-cf6f-44ab-b23e-94947d860055-kube-api-access-clsk6\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:51:38.565412 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:38.565374 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" event={"ID":"9f46c902-cf6f-44ab-b23e-94947d860055","Type":"ContainerDied","Data":"9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed"} Jun 05 11:51:38.565412 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:38.565394 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj" Jun 05 11:51:38.565412 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:51:38.565418 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9c30e90bad982a3c2d44b2d1da29c8ca1f7386e8972452cc804d41ee724b68ed" Jun 05 11:53:28.419545 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.419506 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s"] Jun 05 11:53:28.420035 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.419894 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f46c902-cf6f-44ab-b23e-94947d860055" containerName="node" Jun 05 11:53:28.420035 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.419907 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f46c902-cf6f-44ab-b23e-94947d860055" containerName="node" Jun 05 11:53:28.420035 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.419953 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f46c902-cf6f-44ab-b23e-94947d860055" containerName="node" Jun 05 11:53:28.422228 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.422197 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:28.424680 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.424655 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"default-dockercfg-9w5g7\"" Jun 05 11:53:28.424841 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.424691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"openshift-service-ca.crt\"" Jun 05 11:53:28.425807 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.425770 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"rhai-e2e-progression-xtfzl\"/\"kube-root-ca.crt\"" Jun 05 11:53:28.433752 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.433726 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s"] Jun 05 11:53:28.595126 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.595076 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sv2wm\" (UniqueName: \"kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm\") pod \"progression-no-metrics-node-0-0-dzg5s\" (UID: \"dc200ccc-0a52-4d9f-9e5c-3c23614094f7\") " pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:28.696492 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.696392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sv2wm\" (UniqueName: \"kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm\") pod \"progression-no-metrics-node-0-0-dzg5s\" (UID: \"dc200ccc-0a52-4d9f-9e5c-3c23614094f7\") " pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:28.705733 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.705696 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sv2wm\" (UniqueName: \"kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm\") pod \"progression-no-metrics-node-0-0-dzg5s\" (UID: \"dc200ccc-0a52-4d9f-9e5c-3c23614094f7\") " pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:28.731569 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.731531 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:28.867418 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.867392 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s"] Jun 05 11:53:28.870028 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:53:28.869984 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc200ccc_0a52_4d9f_9e5c_3c23614094f7.slice/crio-027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526 WatchSource:0}: Error finding container 027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526: Status 404 returned error can't find the container with id 027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526 Jun 05 11:53:28.995297 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.995261 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" event={"ID":"dc200ccc-0a52-4d9f-9e5c-3c23614094f7","Type":"ContainerStarted","Data":"3cab468b81c0864f0ed5964373203df8fa6e37e163d2e78b5be8bc562f2f242f"} Jun 05 11:53:28.995475 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:28.995309 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" event={"ID":"dc200ccc-0a52-4d9f-9e5c-3c23614094f7","Type":"ContainerStarted","Data":"027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526"} Jun 05 11:53:29.014850 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:29.014769 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" podStartSLOduration=1.014747504 podStartE2EDuration="1.014747504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:53:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:53:29.013625429 +0000 UTC m=+825.707313211" watchObservedRunningTime="2026-06-05 11:53:29.014747504 +0000 UTC m=+825.708435286" Jun 05 11:53:34.016612 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:34.016573 2566 generic.go:356] "Generic (PLEG): container finished" podID="dc200ccc-0a52-4d9f-9e5c-3c23614094f7" containerID="3cab468b81c0864f0ed5964373203df8fa6e37e163d2e78b5be8bc562f2f242f" exitCode=0 Jun 05 11:53:34.017032 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:34.016647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" event={"ID":"dc200ccc-0a52-4d9f-9e5c-3c23614094f7","Type":"ContainerDied","Data":"3cab468b81c0864f0ed5964373203df8fa6e37e163d2e78b5be8bc562f2f242f"} Jun 05 11:53:35.147408 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:35.147384 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:35.250151 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:35.250114 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sv2wm\" (UniqueName: \"kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm\") pod \"dc200ccc-0a52-4d9f-9e5c-3c23614094f7\" (UID: \"dc200ccc-0a52-4d9f-9e5c-3c23614094f7\") " Jun 05 11:53:35.252295 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:35.252262 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm" (OuterVolumeSpecName: "kube-api-access-sv2wm") pod "dc200ccc-0a52-4d9f-9e5c-3c23614094f7" (UID: "dc200ccc-0a52-4d9f-9e5c-3c23614094f7"). InnerVolumeSpecName "kube-api-access-sv2wm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:53:35.350869 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:35.350746 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sv2wm\" (UniqueName: \"kubernetes.io/projected/dc200ccc-0a52-4d9f-9e5c-3c23614094f7-kube-api-access-sv2wm\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:53:36.025769 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:36.025732 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" event={"ID":"dc200ccc-0a52-4d9f-9e5c-3c23614094f7","Type":"ContainerDied","Data":"027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526"} Jun 05 11:53:36.025769 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:36.025771 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s" Jun 05 11:53:36.025989 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:36.025784 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="027a82ae6ba8361dc9d0f24ff512c7d09b0301e4c5e9562577ed46c71e4c3526" Jun 05 11:53:41.134401 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.134362 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6c4k2/must-gather-dn5z6"] Jun 05 11:53:41.134774 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.134629 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc200ccc-0a52-4d9f-9e5c-3c23614094f7" containerName="node" Jun 05 11:53:41.134774 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.134640 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc200ccc-0a52-4d9f-9e5c-3c23614094f7" containerName="node" Jun 05 11:53:41.134774 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.134700 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc200ccc-0a52-4d9f-9e5c-3c23614094f7" containerName="node" Jun 05 11:53:41.137627 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.137606 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.140264 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.140229 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6c4k2\"/\"kube-root-ca.crt\"" Jun 05 11:53:41.140402 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.140386 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6c4k2\"/\"default-dockercfg-xq8v2\"" Jun 05 11:53:41.141334 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.141321 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6c4k2\"/\"openshift-service-ca.crt\"" Jun 05 11:53:41.145760 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.145735 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6c4k2/must-gather-dn5z6"] Jun 05 11:53:41.192650 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.192610 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqwb\" (UniqueName: \"kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.192650 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.192654 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.293161 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.293122 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqwb\" (UniqueName: \"kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.293355 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.293182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.293570 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.293550 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.302628 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.302602 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqwb\" (UniqueName: \"kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb\") pod \"must-gather-dn5z6\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.447384 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.447277 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:53:41.580544 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.580509 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6c4k2/must-gather-dn5z6"] Jun 05 11:53:41.584168 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:53:41.584144 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddf413175_9307_45d9_ae06_de7d4df7aeff.slice/crio-e68449965b23ead1de64ca74d3c6b508b1f3dbc98eab2b25b2313177b880d0f5 WatchSource:0}: Error finding container e68449965b23ead1de64ca74d3c6b508b1f3dbc98eab2b25b2313177b880d0f5: Status 404 returned error can't find the container with id e68449965b23ead1de64ca74d3c6b508b1f3dbc98eab2b25b2313177b880d0f5 Jun 05 11:53:41.586111 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:41.586094 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 05 11:53:42.053186 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:42.053151 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" event={"ID":"df413175-9307-45d9-ae06-de7d4df7aeff","Type":"ContainerStarted","Data":"e68449965b23ead1de64ca74d3c6b508b1f3dbc98eab2b25b2313177b880d0f5"} Jun 05 11:53:45.410195 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.410152 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9"] Jun 05 11:53:45.418465 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.418434 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-disabled-node-0-0-gb6k9"] Jun 05 11:53:45.423642 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.423614 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl"] Jun 05 11:53:45.427444 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.427402 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-enabled-node-0-0-p79fl"] Jun 05 11:53:45.432047 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.432021 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj"] Jun 05 11:53:45.436248 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.436213 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-invalid-node-0-0-5b5vj"] Jun 05 11:53:45.450274 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.450245 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s"] Jun 05 11:53:45.454064 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.454031 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["rhai-e2e-progression-xtfzl/progression-no-metrics-node-0-0-dzg5s"] Jun 05 11:53:45.774726 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.774686 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f46c902-cf6f-44ab-b23e-94947d860055" path="/var/lib/kubelet/pods/9f46c902-cf6f-44ab-b23e-94947d860055/volumes" Jun 05 11:53:45.775186 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.775166 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2b1b886-6037-4a92-a127-de5df9036a84" path="/var/lib/kubelet/pods/d2b1b886-6037-4a92-a127-de5df9036a84/volumes" Jun 05 11:53:45.775557 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.775543 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc200ccc-0a52-4d9f-9e5c-3c23614094f7" path="/var/lib/kubelet/pods/dc200ccc-0a52-4d9f-9e5c-3c23614094f7/volumes" Jun 05 11:53:45.775980 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:45.775959 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa8fe9e3-6b28-44ff-a332-17b52000ac42" path="/var/lib/kubelet/pods/fa8fe9e3-6b28-44ff-a332-17b52000ac42/volumes" Jun 05 11:53:48.088098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:48.088061 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" event={"ID":"df413175-9307-45d9-ae06-de7d4df7aeff","Type":"ContainerStarted","Data":"ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2"} Jun 05 11:53:48.088098 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:48.088106 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" event={"ID":"df413175-9307-45d9-ae06-de7d4df7aeff","Type":"ContainerStarted","Data":"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745"} Jun 05 11:53:48.105109 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:48.104945 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" podStartSLOduration=0.972040232 podStartE2EDuration="7.104925616s" totalImagesPullingTime="6.132885384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-05 11:53:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:53:48.104880306 +0000 UTC m=+844.798568089" watchObservedRunningTime="2026-06-05 11:53:48.104925616 +0000 UTC m=+844.798613399" Jun 05 11:53:57.813897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:57.813864 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-76ccd4d998-9skzq_86ba3750-b073-4d2a-85e3-23d8ca90c8f4/manager/0.log" Jun 05 11:53:58.317526 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:58.317494 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-76ccd4d998-9skzq_86ba3750-b073-4d2a-85e3-23d8ca90c8f4/manager/0.log" Jun 05 11:53:58.802419 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:53:58.802384 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-76ccd4d998-9skzq_86ba3750-b073-4d2a-85e3-23d8ca90c8f4/manager/0.log" Jun 05 11:54:35.334496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:35.334403 2566 generic.go:356] "Generic (PLEG): container finished" podID="df413175-9307-45d9-ae06-de7d4df7aeff" containerID="c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745" exitCode=0 Jun 05 11:54:35.334496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:35.334445 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" event={"ID":"df413175-9307-45d9-ae06-de7d4df7aeff","Type":"ContainerDied","Data":"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745"} Jun 05 11:54:35.334963 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:35.334771 2566 scope.go:117] "RemoveContainer" containerID="c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745" Jun 05 11:54:36.021830 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:36.021782 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6c4k2_must-gather-dn5z6_df413175-9307-45d9-ae06-de7d4df7aeff/gather/0.log" Jun 05 11:54:39.111224 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:39.111193 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mctkq_24b71ae8-fa13-47f0-9ab2-c14e9f9c16bf/global-pull-secret-syncer/0.log" Jun 05 11:54:39.269508 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:39.269479 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l76v8_efd2cbbf-b8cd-46c2-865a-59d642a4113b/konnectivity-agent/0.log" Jun 05 11:54:39.348528 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:39.348492 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-129.ec2.internal_b7faba1a35fa9fcf7fa91ea1a9e9d3a5/haproxy/0.log" Jun 05 11:54:41.413692 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.413658 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6c4k2/must-gather-dn5z6"] Jun 05 11:54:41.414182 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.413861 2566 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="copy" containerID="cri-o://ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2" gracePeriod=2 Jun 05 11:54:41.420437 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.420413 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6c4k2/must-gather-dn5z6"] Jun 05 11:54:41.421364 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:54:41.421330 2566 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"df413175-9307-45d9-ae06-de7d4df7aeff\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"openshift-must-gather-6c4k2\"/\"must-gather-dn5z6\": pods \"must-gather-dn5z6\" not found" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:54:41.651645 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.651616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6c4k2_must-gather-dn5z6_df413175-9307-45d9-ae06-de7d4df7aeff/copy/0.log" Jun 05 11:54:41.654027 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.654009 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:54:41.656549 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:54:41.656524 2566 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-dn5z6\" is forbidden: User \"system:node:ip-10-0-138-129.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6c4k2\": no relationship found between node 'ip-10-0-138-129.ec2.internal' and this object" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:54:41.717292 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.717210 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output\") pod \"df413175-9307-45d9-ae06-de7d4df7aeff\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " Jun 05 11:54:41.717459 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.717299 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhqwb\" (UniqueName: \"kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb\") pod \"df413175-9307-45d9-ae06-de7d4df7aeff\" (UID: \"df413175-9307-45d9-ae06-de7d4df7aeff\") " Jun 05 11:54:41.719585 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.719549 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "df413175-9307-45d9-ae06-de7d4df7aeff" (UID: "df413175-9307-45d9-ae06-de7d4df7aeff"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 05 11:54:41.719700 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.719679 2566 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb" (OuterVolumeSpecName: "kube-api-access-zhqwb") pod "df413175-9307-45d9-ae06-de7d4df7aeff" (UID: "df413175-9307-45d9-ae06-de7d4df7aeff"). InnerVolumeSpecName "kube-api-access-zhqwb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 05 11:54:41.774036 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.773999 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" path="/var/lib/kubelet/pods/df413175-9307-45d9-ae06-de7d4df7aeff/volumes" Jun 05 11:54:41.818187 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.818153 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhqwb\" (UniqueName: \"kubernetes.io/projected/df413175-9307-45d9-ae06-de7d4df7aeff-kube-api-access-zhqwb\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:54:41.818187 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:41.818183 2566 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/df413175-9307-45d9-ae06-de7d4df7aeff-must-gather-output\") on node \"ip-10-0-138-129.ec2.internal\" DevicePath \"\"" Jun 05 11:54:42.364157 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.364131 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6c4k2_must-gather-dn5z6_df413175-9307-45d9-ae06-de7d4df7aeff/copy/0.log" Jun 05 11:54:42.364495 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.364472 2566 generic.go:356] "Generic (PLEG): container finished" podID="df413175-9307-45d9-ae06-de7d4df7aeff" containerID="ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2" exitCode=143 Jun 05 11:54:42.364555 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.364526 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6c4k2/must-gather-dn5z6" Jun 05 11:54:42.364590 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.364573 2566 scope.go:117] "RemoveContainer" containerID="ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2" Jun 05 11:54:42.372216 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.372190 2566 scope.go:117] "RemoveContainer" containerID="c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745" Jun 05 11:54:42.384502 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.384485 2566 scope.go:117] "RemoveContainer" containerID="ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2" Jun 05 11:54:42.384766 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:54:42.384750 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2\": container with ID starting with ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2 not found: ID does not exist" containerID="ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2" Jun 05 11:54:42.384833 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.384773 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2"} err="failed to get container status \"ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2\": rpc error: code = NotFound desc = could not find container \"ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2\": container with ID starting with ba2ecc7ae24e5d16e490d11ce7185ececd7bbc23f0ca70948871f05a5d8543b2 not found: ID does not exist" Jun 05 11:54:42.384833 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.384807 2566 scope.go:117] "RemoveContainer" containerID="c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745" Jun 05 11:54:42.385018 ip-10-0-138-129 kubenswrapper[2566]: E0605 11:54:42.385001 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745\": container with ID starting with c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745 not found: ID does not exist" containerID="c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745" Jun 05 11:54:42.385060 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:42.385021 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745"} err="failed to get container status \"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745\": rpc error: code = NotFound desc = could not find container \"c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745\": container with ID starting with c3d1556d70851875d2445babf7c5a4f12f310379fa7150c57c1b99b6462ab745 not found: ID does not exist" Jun 05 11:54:43.216063 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.216027 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-n4m9m_dea6d84a-abf2-4e97-ac14-0018ef52671c/kube-state-metrics/0.log" Jun 05 11:54:43.238947 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.238907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-n4m9m_dea6d84a-abf2-4e97-ac14-0018ef52671c/kube-rbac-proxy-main/0.log" Jun 05 11:54:43.264104 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.264074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-n4m9m_dea6d84a-abf2-4e97-ac14-0018ef52671c/kube-rbac-proxy-self/0.log" Jun 05 11:54:43.454535 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.454455 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbts_db62c3be-2181-41c2-ba8b-7262c33e3b8d/node-exporter/0.log" Jun 05 11:54:43.474933 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.474902 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbts_db62c3be-2181-41c2-ba8b-7262c33e3b8d/kube-rbac-proxy/0.log" Jun 05 11:54:43.505237 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.505210 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wtbts_db62c3be-2181-41c2-ba8b-7262c33e3b8d/init-textfile/0.log" Jun 05 11:54:43.616591 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.616562 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxk4p_0d2b9955-82ea-48f3-bf0b-d29e7ccd299d/kube-rbac-proxy-main/0.log" Jun 05 11:54:43.638567 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.638531 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxk4p_0d2b9955-82ea-48f3-bf0b-d29e7ccd299d/kube-rbac-proxy-self/0.log" Jun 05 11:54:43.661369 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.661343 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-wxk4p_0d2b9955-82ea-48f3-bf0b-d29e7ccd299d/openshift-state-metrics/0.log" Jun 05 11:54:43.698102 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.698070 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/prometheus/0.log" Jun 05 11:54:43.721037 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.721014 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/config-reloader/0.log" Jun 05 11:54:43.746225 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.746197 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/thanos-sidecar/0.log" Jun 05 11:54:43.770897 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.770870 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/kube-rbac-proxy-web/0.log" Jun 05 11:54:43.796516 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.795823 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/kube-rbac-proxy/0.log" Jun 05 11:54:43.820126 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.820101 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/kube-rbac-proxy-thanos/0.log" Jun 05 11:54:43.842392 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.842360 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b0089893-e2dd-4bc4-9831-4a14fda6107f/init-config-reloader/0.log" Jun 05 11:54:43.961196 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.961156 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9f4467c6-drffk_ba3423ed-b03b-460b-b861-2f00c2b700bf/telemeter-client/0.log" Jun 05 11:54:43.986851 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:43.986751 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9f4467c6-drffk_ba3423ed-b03b-460b-b861-2f00c2b700bf/reload/0.log" Jun 05 11:54:44.012912 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:44.012868 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-9f4467c6-drffk_ba3423ed-b03b-460b-b861-2f00c2b700bf/kube-rbac-proxy/0.log" Jun 05 11:54:46.919334 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919294 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx"] Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919588 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="copy" Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919599 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="copy" Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919613 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="gather" Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919619 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="gather" Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919666 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="copy" Jun 05 11:54:46.919744 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.919675 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="df413175-9307-45d9-ae06-de7d4df7aeff" containerName="gather" Jun 05 11:54:46.924848 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.924821 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:46.927562 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.927531 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxntj\"/\"openshift-service-ca.crt\"" Jun 05 11:54:46.927694 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.927601 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pxntj\"/\"kube-root-ca.crt\"" Jun 05 11:54:46.928493 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.928477 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pxntj\"/\"default-dockercfg-bbdjx\"" Jun 05 11:54:46.931522 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.931497 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx"] Jun 05 11:54:46.958197 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.958152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-lib-modules\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:46.958363 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.958231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-sys\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:46.958363 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.958280 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-podres\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:46.958363 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.958309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-proc\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:46.958496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:46.958361 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmtfm\" (UniqueName: \"kubernetes.io/projected/7a62cc94-f928-407f-8d46-9a84e063b577-kube-api-access-fmtfm\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059324 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059288 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-lib-modules\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059342 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-sys\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059368 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-podres\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059387 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-proc\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmtfm\" (UniqueName: \"kubernetes.io/projected/7a62cc94-f928-407f-8d46-9a84e063b577-kube-api-access-fmtfm\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059496 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059473 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-lib-modules\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059497 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-proc\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059516 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-sys\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.059658 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.059531 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7a62cc94-f928-407f-8d46-9a84e063b577-podres\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.068581 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.068545 2566 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmtfm\" (UniqueName: \"kubernetes.io/projected/7a62cc94-f928-407f-8d46-9a84e063b577-kube-api-access-fmtfm\") pod \"perf-node-gather-daemonset-9fjpx\" (UID: \"7a62cc94-f928-407f-8d46-9a84e063b577\") " pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.235809 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.235729 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:47.368602 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.368569 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx"] Jun 05 11:54:47.371708 ip-10-0-138-129 kubenswrapper[2566]: W0605 11:54:47.371678 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7a62cc94_f928_407f_8d46_9a84e063b577.slice/crio-ae912dc7415b59605f7275095d1e06312a56179617b9eef355099a85d67a3ac2 WatchSource:0}: Error finding container ae912dc7415b59605f7275095d1e06312a56179617b9eef355099a85d67a3ac2: Status 404 returned error can't find the container with id ae912dc7415b59605f7275095d1e06312a56179617b9eef355099a85d67a3ac2 Jun 05 11:54:47.390082 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.390051 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" event={"ID":"7a62cc94-f928-407f-8d46-9a84e063b577","Type":"ContainerStarted","Data":"ae912dc7415b59605f7275095d1e06312a56179617b9eef355099a85d67a3ac2"} Jun 05 11:54:47.772245 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.772157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-527wx_917c3121-726b-4d66-858e-04433d761cb2/dns/0.log" Jun 05 11:54:47.795375 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.795346 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-527wx_917c3121-726b-4d66-858e-04433d761cb2/kube-rbac-proxy/0.log" Jun 05 11:54:47.903315 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:47.903289 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-8lww9_b1a891d7-0d9d-469a-a558-5593b221f471/dns-node-resolver/0.log" Jun 05 11:54:48.344118 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:48.344084 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8548c45f8c-4f2gm_097e7c15-fb94-448a-8bee-1839deb5600c/registry/0.log" Jun 05 11:54:48.395031 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:48.394997 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" event={"ID":"7a62cc94-f928-407f-8d46-9a84e063b577","Type":"ContainerStarted","Data":"24bfa9326c91679d949895f17f70cc8f54602e6c8007e42cd7741ee1ec9c6e4c"} Jun 05 11:54:48.395178 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:48.395130 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:48.413687 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:48.413631 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" podStartSLOduration=2.41361655 podStartE2EDuration="2.41361655s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-05 11:54:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-05 11:54:48.411455414 +0000 UTC m=+905.105143196" watchObservedRunningTime="2026-06-05 11:54:48.41361655 +0000 UTC m=+905.107304331" Jun 05 11:54:48.427304 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:48.427276 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-z2p74_942f21a4-4334-4203-be51-0f47efa7d7ae/node-ca/0.log" Jun 05 11:54:49.457132 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:49.457092 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r9vvr_c4f9579d-fd82-4944-a0d6-0d7f1a3e4c04/serve-healthcheck-canary/0.log" Jun 05 11:54:50.015692 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:50.015663 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxsqw_c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6/kube-rbac-proxy/0.log" Jun 05 11:54:50.036907 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:50.036863 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxsqw_c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6/exporter/0.log" Jun 05 11:54:50.059164 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:50.059136 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zxsqw_c0e3db9d-fa3f-40b9-b84d-afc4ee4b30f6/extractor/0.log" Jun 05 11:54:51.825596 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:51.825563 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-gxqqm_deab553c-a03f-4f66-bbdb-418ce6e304cc/jobset-operator/0.log" Jun 05 11:54:54.409337 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:54.409310 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pxntj/perf-node-gather-daemonset-9fjpx" Jun 05 11:54:56.587973 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.587907 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/kube-multus-additional-cni-plugins/0.log" Jun 05 11:54:56.609536 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.609509 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/egress-router-binary-copy/0.log" Jun 05 11:54:56.636698 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.636670 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/cni-plugins/0.log" Jun 05 11:54:56.660949 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.660920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/bond-cni-plugin/0.log" Jun 05 11:54:56.682171 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.682084 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/routeoverride-cni/0.log" Jun 05 11:54:56.702646 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.702619 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/whereabouts-cni-bincopy/0.log" Jun 05 11:54:56.724076 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:56.724029 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9x2fd_b157d1ff-fd36-4f19-8f47-5122f2a154ba/whereabouts-cni/0.log" Jun 05 11:54:57.077742 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:57.077708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mh2m5_46978300-0946-4115-a291-80cefa8118f7/kube-multus/0.log" Jun 05 11:54:57.171394 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:57.171361 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lls8g_c4fb895e-e304-4f18-ae1e-d34316ba5ce9/network-metrics-daemon/0.log" Jun 05 11:54:57.194157 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:57.194120 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lls8g_c4fb895e-e304-4f18-ae1e-d34316ba5ce9/kube-rbac-proxy/0.log" Jun 05 11:54:58.283422 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.283389 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-controller/0.log" Jun 05 11:54:58.302500 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.302467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/1.log" Jun 05 11:54:58.302654 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.302476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovn-acl-logging/0.log" Jun 05 11:54:58.320949 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.320925 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/kube-rbac-proxy-node/0.log" Jun 05 11:54:58.343932 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.343901 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/kube-rbac-proxy-ovn-metrics/0.log" Jun 05 11:54:58.363724 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.363696 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/northd/0.log" Jun 05 11:54:58.384088 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.384057 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/nbdb/0.log" Jun 05 11:54:58.407920 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.407892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/sbdb/0.log" Jun 05 11:54:58.463781 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:58.463732 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rkx2v_9df92fe6-ac1e-40af-8a62-d9951836caf0/ovnkube-controller/0.log" Jun 05 11:54:59.730059 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:54:59.730030 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-c6g7h_94becad8-2357-4ffd-a254-0ad3338b7e4c/network-check-target-container/0.log" Jun 05 11:55:00.679169 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:55:00.679136 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-8wq78_b76b44dc-1800-47da-aea9-15676a1c27b6/iptables-alerter/0.log" Jun 05 11:55:01.410366 ip-10-0-138-129 kubenswrapper[2566]: I0605 11:55:01.410335 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-pmcz6_688a6069-01fd-44e7-99f7-04174fc1d4b8/tuned/0.log"