Jun 16 19:49:07.399753 ip-10-0-139-232 systemd[1]: Starting Kubernetes Kubelet... Jun 16 19:49:07.837990 ip-10-0-139-232 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:07.837990 ip-10-0-139-232 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 16 19:49:07.837990 ip-10-0-139-232 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:07.837990 ip-10-0-139-232 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 16 19:49:07.837990 ip-10-0-139-232 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 16 19:49:07.839984 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.839892 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 16 19:49:07.843923 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843902 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.843923 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843923 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843927 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843931 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843934 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843938 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843941 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843945 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843947 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843950 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843953 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843961 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843964 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843967 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843970 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843972 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843975 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843977 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843980 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843983 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843985 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.843999 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843988 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843990 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843993 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843996 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.843999 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844002 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844004 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844009 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844011 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844014 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844017 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844020 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844022 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844025 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844029 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844033 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844036 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844038 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844041 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.844495 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844043 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844046 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844048 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844050 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844055 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844059 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844061 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844064 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844067 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844070 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844073 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844075 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844078 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844081 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844083 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844086 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844089 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844092 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844094 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.844980 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844097 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844099 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844102 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844104 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844106 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844110 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844113 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844115 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844118 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844120 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844123 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844125 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844128 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844130 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844133 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844135 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844138 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844141 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844144 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.845459 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844147 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844151 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844154 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844157 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844160 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844163 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844165 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844168 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844171 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844174 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844177 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844179 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844182 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844184 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844187 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844189 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844192 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844195 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844197 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844200 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.845959 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844202 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844972 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844979 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844982 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844985 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844988 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844991 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844994 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844996 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.844999 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845002 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845005 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845013 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845018 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845021 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845024 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845027 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845030 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845033 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.846464 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845036 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845039 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845041 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845044 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845046 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845049 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845053 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845056 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845059 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845062 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845065 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845067 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845070 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845072 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845075 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845078 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845080 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845083 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845086 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845088 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.846990 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845091 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845093 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845096 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845098 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845101 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845103 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845106 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845109 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845113 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845116 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845120 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845123 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845126 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845129 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845132 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845135 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845138 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845140 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845143 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845146 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.847491 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845149 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845152 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845155 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845158 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845160 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845163 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845166 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845168 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845170 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845173 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845175 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845196 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845200 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845203 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845206 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845209 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845212 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845215 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845218 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845222 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.847985 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845225 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845228 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845230 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845233 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845235 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845238 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845240 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845243 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845246 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845248 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845251 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845253 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845256 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845259 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845261 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845264 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845267 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845269 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845272 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.848481 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845274 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845277 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845693 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845698 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845701 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845704 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845707 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845710 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845712 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845715 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845718 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845720 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845724 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845727 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845729 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845732 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845734 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845737 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845739 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845742 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.848944 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845745 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845747 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845750 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845752 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845757 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845761 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845764 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845767 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845769 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845772 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845775 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845778 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845780 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845783 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845785 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845787 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845790 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845792 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845795 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.849416 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845797 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845799 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845802 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845805 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845808 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845810 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845813 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845816 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845818 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845821 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845823 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845826 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845828 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845831 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845833 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845836 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845839 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845842 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845844 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845846 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.849895 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845850 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845853 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845856 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845859 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845861 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845864 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845866 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845869 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845871 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845874 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845876 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845879 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845881 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845884 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845887 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845890 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845898 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845901 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845904 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845908 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.850369 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845911 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845913 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845916 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845918 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845921 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845923 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845926 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845928 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845931 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845934 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845936 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845939 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845941 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845944 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845947 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845949 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845952 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845954 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845957 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.850904 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845959 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845962 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.845965 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846041 2576 flags.go:64] FLAG: --address="0.0.0.0" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846053 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846059 2576 flags.go:64] FLAG: --anonymous-auth="true" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846064 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846068 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846071 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846077 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846084 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846087 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846090 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846094 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846098 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846101 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846104 2576 flags.go:64] FLAG: --cgroup-root="" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846107 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846110 2576 flags.go:64] FLAG: --client-ca-file="" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846113 2576 flags.go:64] FLAG: --cloud-provider="external" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846116 2576 flags.go:64] FLAG: --cluster-dns="[]" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846121 2576 flags.go:64] FLAG: --cluster-domain="" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846124 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 16 19:49:07.851367 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846127 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846130 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846134 2576 flags.go:64] FLAG: --container-log-max-files="5" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846138 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846141 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846145 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846149 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846152 2576 flags.go:64] FLAG: --contention-profiling="false" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846155 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846158 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846161 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846164 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846168 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846171 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846174 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846177 2576 flags.go:64] FLAG: --enable-load-reader="false" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846180 2576 flags.go:64] FLAG: --enable-server="true" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846184 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846189 2576 flags.go:64] FLAG: --event-burst="100" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846193 2576 flags.go:64] FLAG: --event-qps="50" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846197 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846200 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846203 2576 flags.go:64] FLAG: --eviction-hard="" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846208 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 16 19:49:07.851976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846210 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846213 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846216 2576 flags.go:64] FLAG: --eviction-soft="" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846219 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846222 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846225 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846228 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846231 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846234 2576 flags.go:64] FLAG: --fail-swap-on="true" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846237 2576 flags.go:64] FLAG: --feature-gates="" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846241 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846244 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846247 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846250 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846253 2576 flags.go:64] FLAG: --healthz-port="10248" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846256 2576 flags.go:64] FLAG: --help="false" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846259 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-139-232.ec2.internal" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846262 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846266 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846269 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846272 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846275 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846278 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 16 19:49:07.852589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846281 2576 flags.go:64] FLAG: --image-service-endpoint="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846284 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846286 2576 flags.go:64] FLAG: --kube-api-burst="100" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846291 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846295 2576 flags.go:64] FLAG: --kube-api-qps="50" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846300 2576 flags.go:64] FLAG: --kube-reserved="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846302 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846305 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846309 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846312 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846315 2576 flags.go:64] FLAG: --lock-file="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846318 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846320 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846324 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846329 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846332 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846335 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846338 2576 flags.go:64] FLAG: --logging-format="text" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846341 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846344 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846347 2576 flags.go:64] FLAG: --manifest-url="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846350 2576 flags.go:64] FLAG: --manifest-url-header="" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846354 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846356 2576 flags.go:64] FLAG: --max-open-files="1000000" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846361 2576 flags.go:64] FLAG: --max-pods="110" Jun 16 19:49:07.853211 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846364 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846367 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846370 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846373 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846376 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846379 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846382 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846392 2576 flags.go:64] FLAG: --node-status-max-images="50" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846395 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846398 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846402 2576 flags.go:64] FLAG: --pod-cidr="" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846406 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846413 2576 flags.go:64] FLAG: --pod-manifest-path="" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846416 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846420 2576 flags.go:64] FLAG: --pods-per-core="0" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846423 2576 flags.go:64] FLAG: --port="10250" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846426 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846429 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03a80d7a23bbeacb1" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846445 2576 flags.go:64] FLAG: --qos-reserved="" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846448 2576 flags.go:64] FLAG: --read-only-port="10255" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846451 2576 flags.go:64] FLAG: --register-node="true" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846454 2576 flags.go:64] FLAG: --register-with-taints="" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846458 2576 flags.go:64] FLAG: --registry-burst="10" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846461 2576 flags.go:64] FLAG: --registry-qps="5" Jun 16 19:49:07.853964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846464 2576 flags.go:64] FLAG: --reserved-cpus="" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846468 2576 flags.go:64] FLAG: --reserved-memory="" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846472 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846475 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846478 2576 flags.go:64] FLAG: --rotate-certificates="false" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846481 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846484 2576 flags.go:64] FLAG: --runonce="false" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846487 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846490 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846493 2576 flags.go:64] FLAG: --seccomp-default="false" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846496 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846499 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846502 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846505 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846508 2576 flags.go:64] FLAG: --storage-driver-password="root" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846511 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846514 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846517 2576 flags.go:64] FLAG: --storage-driver-user="root" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846519 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846523 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846528 2576 flags.go:64] FLAG: --system-cgroups="" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846530 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846536 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846539 2576 flags.go:64] FLAG: --tls-cert-file="" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846541 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 16 19:49:07.854915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846546 2576 flags.go:64] FLAG: --tls-min-version="" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846550 2576 flags.go:64] FLAG: --tls-private-key-file="" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846553 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846555 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846558 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846561 2576 flags.go:64] FLAG: --v="2" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846565 2576 flags.go:64] FLAG: --version="false" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846569 2576 flags.go:64] FLAG: --vmodule="" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846573 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.846576 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846720 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846725 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846728 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846730 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846733 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846735 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846738 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846740 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846743 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846745 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846748 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846751 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.855586 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846753 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846756 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846759 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846761 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846764 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846768 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846771 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846773 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846776 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846779 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846782 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846784 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846787 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846790 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846794 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846797 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846800 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846803 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846806 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.856124 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846808 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846811 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846813 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846816 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846819 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846821 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846824 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846826 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846829 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846831 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846834 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846836 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846839 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846842 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846845 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846848 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846850 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846853 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846857 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846860 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.856639 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846862 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846867 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846870 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846873 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846876 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846879 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846882 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846885 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846888 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846891 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846893 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846896 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846899 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846901 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846904 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846906 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846909 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846912 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846914 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.857145 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846917 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846920 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846924 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846926 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846929 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846931 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846934 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846937 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846939 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846942 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846944 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846948 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846951 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846953 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846956 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846958 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846961 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846964 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846966 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846969 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.857628 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846972 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846974 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846977 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846979 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846982 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846984 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846987 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846989 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.846992 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.847706 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.855922 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.855942 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.855968 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.855975 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856039 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.858115 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856048 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856052 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856055 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856058 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856061 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856065 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856067 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856070 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856073 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856076 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856079 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856081 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856084 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856087 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856089 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856092 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856095 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856099 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856103 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.858494 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856106 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856110 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856114 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856119 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856123 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856127 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856131 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856134 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856137 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856141 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856143 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856146 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856149 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856152 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856155 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856157 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856160 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856163 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856165 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856168 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.858964 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856171 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856173 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856176 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856178 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856181 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856183 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856187 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856189 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856192 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856195 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856200 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856204 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856209 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856213 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856216 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856218 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856221 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856223 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856226 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856228 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.859542 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856231 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856233 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856236 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856240 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856244 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856247 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856249 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856252 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856255 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856257 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856260 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856263 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856265 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856268 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856270 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856274 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856281 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856285 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856289 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.860017 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856294 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856297 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856299 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856302 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856305 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856307 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856310 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856312 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856315 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856318 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856320 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856323 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856325 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856328 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856331 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856334 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856336 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856339 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856341 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.860535 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856344 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.856349 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856508 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856515 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856518 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856522 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856528 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856532 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856537 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856540 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856543 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856546 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856549 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856551 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856555 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 16 19:49:07.861016 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856558 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856560 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856563 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856566 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856569 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856572 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856575 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856578 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856580 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856583 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856585 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856588 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856590 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856593 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856597 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856601 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856607 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856614 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856619 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 16 19:49:07.861390 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856622 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856625 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856628 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856631 2576 feature_gate.go:328] unrecognized feature gate: Example Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856634 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856637 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856639 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856642 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856645 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856648 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856651 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856653 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856656 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856660 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856663 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856666 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856668 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856671 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856674 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 16 19:49:07.862171 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856676 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856679 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856682 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856686 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856690 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856694 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856699 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856702 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856705 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856707 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856709 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856712 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856714 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856717 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856719 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856722 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856724 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856727 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856729 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 16 19:49:07.862850 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856731 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856734 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856737 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856741 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856744 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856748 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856751 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856754 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856758 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856761 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856765 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856770 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856774 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856779 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856783 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856786 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856788 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856791 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856794 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856796 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 16 19:49:07.863332 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856799 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856801 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856804 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856806 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856812 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856814 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856817 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856819 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:07.856822 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.856827 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.856958 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.859946 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.861405 2576 server.go:1019] "Starting client certificate rotation" Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.861523 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:49:07.863948 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.861581 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 16 19:49:07.864762 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.864746 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:49:07.868955 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.868930 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 16 19:49:07.878278 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.878253 2576 log.go:25] "Validated CRI v1 runtime API" Jun 16 19:49:07.884881 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.884861 2576 log.go:25] "Validated CRI v1 image API" Jun 16 19:49:07.885783 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.885761 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 16 19:49:07.888223 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.888187 2576 fs.go:135] Filesystem UUIDs: map[0ae302e9-4db1-467f-ba0e-96d069d5b44d:/dev/nvme0n1p3 61f18f3d-0c29-4e88-bc89-dd7ddd545254:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 16 19:49:07.888223 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.888218 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 16 19:49:07.893294 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.893171 2576 manager.go:216] Machine: {Timestamp:2026-06-16 19:49:07.891786306 +0000 UTC m=+0.370846795 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099721 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ebec76ddb461e5126d5ebbcc1d271 SystemUUID:ec2ebec7-6ddb-461e-5126-d5ebbcc1d271 BootID:dff9fc7f-e4d0-43ba-9c42-144bea05bfbe Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cb:a3:4e:97:f3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cb:a3:4e:97:f3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:d6:46:47:f0:16:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 16 19:49:07.893294 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.893279 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 16 19:49:07.893430 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.893410 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 16 19:49:07.895069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.894995 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 16 19:49:07.895749 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.895064 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-232.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 16 19:49:07.895907 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.895889 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:49:07.897180 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.897165 2576 topology_manager.go:138] "Creating topology manager with none policy" Jun 16 19:49:07.897218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.897187 2576 container_manager_linux.go:309] "Creating device plugin manager" Jun 16 19:49:07.897218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.897198 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:49:07.897767 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.897754 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 16 19:49:07.899104 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.899093 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 16 19:49:07.901914 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.901902 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:49:07.902045 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902036 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 16 19:49:07.902074 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902066 2576 kubelet.go:486] "Attempting to sync node with API server" Jun 16 19:49:07.902101 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902076 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 16 19:49:07.902101 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902094 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 16 19:49:07.902165 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902105 2576 kubelet.go:398] "Adding apiserver pod source" Jun 16 19:49:07.902165 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902114 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 16 19:49:07.902548 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902536 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:49:07.902588 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.902558 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 16 19:49:07.905062 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.905038 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 16 19:49:07.906585 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906569 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 16 19:49:07.906669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906602 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 16 19:49:07.906782 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906770 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 16 19:49:07.906839 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906786 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 16 19:49:07.906839 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906794 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 16 19:49:07.906839 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906800 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 16 19:49:07.906839 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906808 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 16 19:49:07.906839 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.906814 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 16 19:49:07.907403 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907390 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 16 19:49:07.907452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907404 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 16 19:49:07.907452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907412 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 16 19:49:07.907452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907418 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 16 19:49:07.907452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907427 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 16 19:49:07.907452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907451 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 16 19:49:07.907604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907480 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 16 19:49:07.907604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.907488 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 16 19:49:07.911298 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.911101 2576 server.go:1268] "Started kubelet" Jun 16 19:49:07.911428 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.911156 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 16 19:49:07.911534 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.911188 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 16 19:49:07.911588 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.911574 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 16 19:49:07.912198 ip-10-0-139-232 systemd[1]: Started Kubernetes Kubelet. Jun 16 19:49:07.912779 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.912319 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-232.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 16 19:49:07.912948 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.912920 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 16 19:49:07.913006 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.912980 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 16 19:49:07.913218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.913161 2576 server.go:310] "Adding debug handlers to kubelet server" Jun 16 19:49:07.913548 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.913532 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 16 19:49:07.917970 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.917948 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 16 19:49:07.918071 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918038 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 16 19:49:07.918131 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.918073 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 16 19:49:07.918322 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.918302 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:07.918581 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.917586 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-232.ec2.internal.18b9a78c22191792 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-232.ec2.internal,UID:ip-10-0-139-232.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-232.ec2.internal,},FirstTimestamp:2026-06-16 19:49:07.911071634 +0000 UTC m=+0.390132103,LastTimestamp:2026-06-16 19:49:07.911071634 +0000 UTC m=+0.390132103,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-232.ec2.internal,}" Jun 16 19:49:07.918699 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918664 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 16 19:49:07.918755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918716 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 16 19:49:07.918755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918732 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 16 19:49:07.918856 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918827 2576 reconstruct.go:97] "Volume reconstruction finished" Jun 16 19:49:07.918899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918857 2576 reconciler.go:29] "Reconciler: start to sync state" Jun 16 19:49:07.918935 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918920 2576 factory.go:55] Registering systemd factory Jun 16 19:49:07.918976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.918959 2576 factory.go:223] Registration of the systemd container factory successfully Jun 16 19:49:07.919208 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919191 2576 factory.go:153] Registering CRI-O factory Jun 16 19:49:07.919208 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919207 2576 factory.go:223] Registration of the crio container factory successfully Jun 16 19:49:07.919341 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919265 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 16 19:49:07.919341 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919289 2576 factory.go:103] Registering Raw factory Jun 16 19:49:07.919341 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919303 2576 manager.go:1196] Started watching for new ooms in manager Jun 16 19:49:07.919796 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.919778 2576 manager.go:349] Starting recovery of all containers Jun 16 19:49:07.929358 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.929293 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 16 19:49:07.929596 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.929567 2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-232.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 16 19:49:07.929686 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.929611 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 16 19:49:07.931313 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.930977 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jd799" Jun 16 19:49:07.931405 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.931341 2576 manager.go:354] Recovery completed Jun 16 19:49:07.936617 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.936604 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:07.938619 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.938564 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:07.938619 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.938599 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:07.938619 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.938615 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:07.939157 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939143 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 16 19:49:07.939157 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939154 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 16 19:49:07.939157 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939149 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:07.939298 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939170 2576 state_mem.go:36] "Initialized new in-memory state store" Jun 16 19:49:07.939757 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939741 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jd799" Jun 16 19:49:07.939914 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939893 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:07.939986 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939924 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:07.939986 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.939934 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:07.940640 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.940624 2576 policy_none.go:49] "None policy: Start" Jun 16 19:49:07.940701 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.940646 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 16 19:49:07.940701 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.940658 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 16 19:49:07.941698 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.941684 2576 policy_none.go:47] "Start" Jun 16 19:49:07.975214 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975177 2576 manager.go:337] "Starting Device Plugin manager" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.975318 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975338 2576 server.go:87] "Starting device plugin registration server" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975687 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975714 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975799 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975912 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.975922 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.976771 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.976817 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.988531 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.988570 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.988591 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:07.988628 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 16 19:49:07.991604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:07.990737 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:08.076173 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.076138 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:08.077365 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.077341 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:08.077365 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.077379 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:08.077543 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.077395 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:08.077543 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.077419 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.086180 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.086161 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.086235 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.086194 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-232.ec2.internal\": node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.089247 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.089193 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal"] Jun 16 19:49:08.089304 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.089275 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:08.090836 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.090818 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:08.090919 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.090847 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:08.090919 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.090856 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:08.092132 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.092120 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:08.092233 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.092221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.092270 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.092250 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:08.092979 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.092964 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:08.093055 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.092998 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:08.093055 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.093014 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:08.093055 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.093012 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:08.093150 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.093074 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:08.093150 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.093087 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:08.094465 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.094451 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.094517 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.094477 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 16 19:49:08.095544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.095530 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientMemory" Jun 16 19:49:08.095622 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.095555 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasNoDiskPressure" Jun 16 19:49:08.095622 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.095564 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeHasSufficientPID" Jun 16 19:49:08.103166 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.103149 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.119040 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.119017 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb95cf55887de53e5ea257c2ce412d4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-232.ec2.internal\" (UID: \"4eb95cf55887de53e5ea257c2ce412d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.119118 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.119044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.119118 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.119063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.120267 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.120253 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-232.ec2.internal\" not found" node="ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.124684 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.124670 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-232.ec2.internal\" not found" node="ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.203482 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.203453 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.219428 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219400 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb95cf55887de53e5ea257c2ce412d4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-232.ec2.internal\" (UID: \"4eb95cf55887de53e5ea257c2ce412d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.219509 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.219509 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219494 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.219509 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219497 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/4eb95cf55887de53e5ea257c2ce412d4-config\") pod \"kube-apiserver-proxy-ip-10-0-139-232.ec2.internal\" (UID: \"4eb95cf55887de53e5ea257c2ce412d4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.219614 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219526 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.219614 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.219554 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f94d807c79eea6338eef3d4fdba8ae7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal\" (UID: \"8f94d807c79eea6338eef3d4fdba8ae7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.303568 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.303535 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.404234 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.404168 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.422586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.422550 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.428718 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.428698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:08.504954 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.504914 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.605430 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.605396 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.706000 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.705924 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.806415 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.806384 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.860943 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.860904 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 16 19:49:08.861852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.861068 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 16 19:49:08.888536 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.888508 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:08.906898 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:08.906859 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:08.923256 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:08.923209 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4eb95cf55887de53e5ea257c2ce412d4.slice/crio-2b4101d6ee54165b6dcdc8bc0d6ccb1bff4b06ae2f351d758efc2337fe13d741 WatchSource:0}: Error finding container 2b4101d6ee54165b6dcdc8bc0d6ccb1bff4b06ae2f351d758efc2337fe13d741: Status 404 returned error can't find the container with id 2b4101d6ee54165b6dcdc8bc0d6ccb1bff4b06ae2f351d758efc2337fe13d741 Jun 16 19:49:08.923664 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:08.923643 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f94d807c79eea6338eef3d4fdba8ae7.slice/crio-1e14aa151e2b4c7daadf50b09ba64a6d360130c6f251810782065f1a47a0326e WatchSource:0}: Error finding container 1e14aa151e2b4c7daadf50b09ba64a6d360130c6f251810782065f1a47a0326e: Status 404 returned error can't find the container with id 1e14aa151e2b4c7daadf50b09ba64a6d360130c6f251810782065f1a47a0326e Jun 16 19:49:08.929242 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.929214 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:49:08.940074 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.940054 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:08.943825 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.943789 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-15 19:44:07 +0000 UTC" deadline="2028-03-21 01:13:50.35531288 +0000 UTC" Jun 16 19:49:08.943825 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.943822 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15437h24m41.411495716s" Jun 16 19:49:08.994469 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.994352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" event={"ID":"8f94d807c79eea6338eef3d4fdba8ae7","Type":"ContainerStarted","Data":"1e14aa151e2b4c7daadf50b09ba64a6d360130c6f251810782065f1a47a0326e"} Jun 16 19:49:08.995386 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:08.995364 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" event={"ID":"4eb95cf55887de53e5ea257c2ce412d4","Type":"ContainerStarted","Data":"2b4101d6ee54165b6dcdc8bc0d6ccb1bff4b06ae2f351d758efc2337fe13d741"} Jun 16 19:49:09.007573 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.007541 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:09.108158 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.108118 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:09.208642 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.208603 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:09.309171 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.309087 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:09.410013 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.409980 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-232.ec2.internal\" not found" Jun 16 19:49:09.503588 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.503558 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:09.519250 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.519044 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" Jun 16 19:49:09.539047 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.539020 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:49:09.540626 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.540579 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" Jun 16 19:49:09.548653 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.548630 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 16 19:49:09.769728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.769646 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 16 19:49:09.903240 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.903207 2576 apiserver.go:52] "Watching apiserver" Jun 16 19:49:09.912610 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.912582 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 16 19:49:09.913189 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.913151 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22","openshift-cluster-node-tuning-operator/tuned-vm8rq","openshift-dns/node-resolver-99zv5","openshift-image-registry/node-ca-jm8mm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal","openshift-network-diagnostics/network-check-target-cw776","openshift-network-operator/iptables-alerter-w4ksc","kube-system/global-pull-secret-syncer-6mfpr","kube-system/konnectivity-agent-x62cp","openshift-multus/multus-55sp8","openshift-multus/multus-additional-cni-plugins-85m77","openshift-multus/network-metrics-daemon-rzff4","openshift-ovn-kubernetes/ovnkube-node-xsgmv"] Jun 16 19:49:09.915032 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.915014 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:09.915161 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.915107 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:09.916201 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.916181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:09.916317 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.916242 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:09.917278 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.917255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.918387 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.918370 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 16 19:49:09.919068 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.919048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:09.919831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.919794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4cmkz\"" Jun 16 19:49:09.919831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.919812 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.919997 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.919801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.920300 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.920262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:09.921580 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.921559 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cdrc8\"" Jun 16 19:49:09.921673 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.921636 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.921673 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.921653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.921785 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.921770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:09.922925 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.922905 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.923022 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.922967 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xcpzm\"" Jun 16 19:49:09.923411 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.923203 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:09.923411 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.923227 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.923411 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.923249 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 16 19:49:09.923411 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:09.923274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:09.924674 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.924612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:09.925331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.925290 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 16 19:49:09.925331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.925314 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.925583 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.925564 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-d2hcr\"" Jun 16 19:49:09.925800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.925784 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.925878 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.925828 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 16 19:49:09.926191 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.926032 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 16 19:49:09.926191 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.926078 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 16 19:49:09.927238 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.927176 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.928741 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.928822 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.928957 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zsdgn\"" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929148 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-kubernetes\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929170 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929183 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-conf\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929211 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-run\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-sys\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwvw\" (UniqueName: \"kubernetes.io/projected/561341c8-d2e1-4a23-b607-94e68ba3476f-kube-api-access-tvwvw\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/783d336e-36c9-449a-a88c-4b277c73ed72-hosts-file\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929463 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n58mk\" (UniqueName: \"kubernetes.io/projected/783d336e-36c9-449a-a88c-4b277c73ed72-kube-api-access-n58mk\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9khc\" (UniqueName: \"kubernetes.io/projected/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-kube-api-access-v9khc\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-lib-modules\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.929557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-host\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929601 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-tuned\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bd96be0-3cef-435e-9749-b822ffee261e-host\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bd96be0-3cef-435e-9749-b822ffee261e-serviceca\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppvdv\" (UniqueName: \"kubernetes.io/projected/3bd96be0-3cef-435e-9749-b822ffee261e-kube-api-access-ppvdv\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929831 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929877 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-modprobe-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.929971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-systemd\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930010 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-var-lib-kubelet\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930033 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-tmp\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783d336e-36c9-449a-a88c-4b277c73ed72-tmp-dir\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:09.930265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysconfig\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:09.931080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930391 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.931080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.930783 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:09.931400 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.931241 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.931400 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.931261 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 16 19:49:09.934675 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.934638 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 16 19:49:09.934923 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.934901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hztzm\"" Jun 16 19:49:09.935397 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.935271 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:09.936009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.935518 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55sp8" Jun 16 19:49:09.936009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.935593 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 16 19:49:09.936009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.935945 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-k2h9l\"" Jun 16 19:49:09.936009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.935998 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 16 19:49:09.937722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.937706 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 16 19:49:09.937859 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.937734 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 16 19:49:09.938303 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.938283 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 16 19:49:09.939051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.938653 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 16 19:49:09.939051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.938815 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bp92p\"" Jun 16 19:49:09.939051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.938902 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-fgtds\"" Jun 16 19:49:09.939051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.939033 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 16 19:49:09.939722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.939701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 16 19:49:09.955361 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.955337 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b64r6" Jun 16 19:49:09.964874 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:09.964830 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b64r6" Jun 16 19:49:10.019597 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.019559 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 16 19:49:10.030834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovn-node-metrics-cert\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.030834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030799 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.030834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030817 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-multus-certs\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030877 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-tmp\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-netns\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030952 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-var-lib-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.030959 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030979 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.030995 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cni-binary-copy\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031016 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-k8s-cni-cncf-io\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031039 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-hostroot\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031069 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.031070 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.531034636 +0000 UTC m=+3.010095106 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031131 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwvw\" (UniqueName: \"kubernetes.io/projected/561341c8-d2e1-4a23-b607-94e68ba3476f-kube-api-access-tvwvw\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031173 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n58mk\" (UniqueName: \"kubernetes.io/projected/783d336e-36c9-449a-a88c-4b277c73ed72-kube-api-access-n58mk\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031200 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-etc-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031370 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw85p\" (UniqueName: \"kubernetes.io/projected/6889e015-f489-44ef-8bb1-91db789b1c98-kube-api-access-dw85p\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031235 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-system-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031470 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-etc-kubernetes\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031496 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbw56\" (UniqueName: \"kubernetes.io/projected/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-kube-api-access-lbw56\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-lib-modules\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031555 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031579 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cnibin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031628 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-systemd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-system-cni-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031697 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-lib-modules\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031726 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-device-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031771 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031805 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-daemon-config\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.031844 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783d336e-36c9-449a-a88c-4b277c73ed72-tmp-dir\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031884 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031969 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-config\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cnibin\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032036 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-kubernetes\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032121 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/783d336e-36c9-449a-a88c-4b277c73ed72-hosts-file\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032150 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/783d336e-36c9-449a-a88c-4b277c73ed72-tmp-dir\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bd96be0-3cef-435e-9749-b822ffee261e-serviceca\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032192 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-kubernetes\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032184 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/783d336e-36c9-449a-a88c-4b277c73ed72-hosts-file\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032218 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-systemd-units\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-node-log\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-os-release\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032306 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-tuned\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.032370 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032363 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bd96be0-3cef-435e-9749-b822ffee261e-host\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.031963 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-registration-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032687 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-multus\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-conf-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032763 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1bd596-2ed1-4c85-a74c-752ac228c987-iptables-alerter-script\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-bin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032831 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-systemd\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032881 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-var-lib-kubelet\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032938 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-script-lib\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.032953 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3bd96be0-3cef-435e-9749-b822ffee261e-serviceca\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-var-lib-kubelet\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033115 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-systemd\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-os-release\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033178 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3bd96be0-3cef-435e-9749-b822ffee261e-host\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysconfig\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033243 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-conf\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033275 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysconfig\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033313 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-run\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033345 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppvdv\" (UniqueName: \"kubernetes.io/projected/3bd96be0-3cef-435e-9749-b822ffee261e-kube-api-access-ppvdv\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033374 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-log-socket\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-sysctl-conf\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-bin\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033417 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-run\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033499 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-env-overrides\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033538 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1bd596-2ed1-4c85-a74c-752ac228c987-host-slash\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033579 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9khc\" (UniqueName: \"kubernetes.io/projected/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-kube-api-access-v9khc\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-host\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033635 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63814b2c-fc48-4715-9508-2357758d6f40-agent-certs\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.033700 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033671 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-binary-copy\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033797 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-host\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033826 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-kubelet-config\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-socket-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033920 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-sys-fs\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-socket-dir-parent\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-netd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.033998 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-dbus\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034023 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-kubelet\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-kubelet\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034076 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-modprobe-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034108 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m89fj\" (UniqueName: \"kubernetes.io/projected/8f1bd596-2ed1-4c85-a74c-752ac228c987-kube-api-access-m89fj\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfvz7\" (UniqueName: \"kubernetes.io/projected/06d2c47d-8462-4dce-9f53-75d1bc58e09b-kube-api-access-vfvz7\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034170 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-sys\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-ovn\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-netns\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.034419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-slash\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034307 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034385 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cxzm\" (UniqueName: \"kubernetes.io/projected/faf7353a-f06c-4cf6-bff3-cb589cb12d36-kube-api-access-8cxzm\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-modprobe-d\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034492 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/561341c8-d2e1-4a23-b607-94e68ba3476f-sys\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63814b2c-fc48-4715-9508-2357758d6f40-konnectivity-ca\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.035267 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.034580 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.037032 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.036919 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-tmp\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.037142 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.037024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/561341c8-d2e1-4a23-b607-94e68ba3476f-etc-tuned\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.045059 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.045036 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:10.045175 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.045064 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:10.045175 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.045077 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.045175 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.045146 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.545128466 +0000 UTC m=+3.024188922 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.045967 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.045943 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n58mk\" (UniqueName: \"kubernetes.io/projected/783d336e-36c9-449a-a88c-4b277c73ed72-kube-api-access-n58mk\") pod \"node-resolver-99zv5\" (UID: \"783d336e-36c9-449a-a88c-4b277c73ed72\") " pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.048995 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.048974 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppvdv\" (UniqueName: \"kubernetes.io/projected/3bd96be0-3cef-435e-9749-b822ffee261e-kube-api-access-ppvdv\") pod \"node-ca-jm8mm\" (UID: \"3bd96be0-3cef-435e-9749-b822ffee261e\") " pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.049379 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.049359 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9khc\" (UniqueName: \"kubernetes.io/projected/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-kube-api-access-v9khc\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:10.050046 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.050026 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwvw\" (UniqueName: \"kubernetes.io/projected/561341c8-d2e1-4a23-b607-94e68ba3476f-kube-api-access-tvwvw\") pod \"tuned-vm8rq\" (UID: \"561341c8-d2e1-4a23-b607-94e68ba3476f\") " pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.135384 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135342 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-registration-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.135384 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-multus\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-registration-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135484 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-multus\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-conf-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135533 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1bd596-2ed1-4c85-a74c-752ac228c987-iptables-alerter-script\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-bin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-script-lib\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-conf-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.135634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135603 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-os-release\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135648 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-cni-bin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135680 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-log-socket\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135707 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-bin\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-os-release\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135729 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-env-overrides\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135761 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-log-socket\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1bd596-2ed1-4c85-a74c-752ac228c987-host-slash\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63814b2c-fc48-4715-9508-2357758d6f40-agent-certs\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135842 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-binary-copy\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135866 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-kubelet-config\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135903 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-socket-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-sys-fs\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-socket-dir-parent\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-netd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136006 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.135992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-dbus\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-kubelet\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-kubelet\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m89fj\" (UniqueName: \"kubernetes.io/projected/8f1bd596-2ed1-4c85-a74c-752ac228c987-kube-api-access-m89fj\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfvz7\" (UniqueName: \"kubernetes.io/projected/06d2c47d-8462-4dce-9f53-75d1bc58e09b-kube-api-access-vfvz7\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136095 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-ovn\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136117 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136139 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-netns\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-env-overrides\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-slash\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136186 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f1bd596-2ed1-4c85-a74c-752ac228c987-iptables-alerter-script\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136226 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-bin\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136228 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-script-lib\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136239 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cxzm\" (UniqueName: \"kubernetes.io/projected/faf7353a-f06c-4cf6-bff3-cb589cb12d36-kube-api-access-8cxzm\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136240 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f1bd596-2ed1-4c85-a74c-752ac228c987-host-slash\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136269 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63814b2c-fc48-4715-9508-2357758d6f40-konnectivity-ca\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.136705 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136272 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-var-lib-kubelet\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-kubelet-config\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136339 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136349 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovn-node-metrics-cert\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136449 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-socket-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-socket-dir-parent\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136721 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136625 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-slash\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136660 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-sys-fs\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136663 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-cni-netd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136693 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-netns\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-dbus\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136807 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/63814b2c-fc48-4715-9508-2357758d6f40-konnectivity-ca\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.136886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-multus-certs\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137056 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-multus-certs\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.137514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137061 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137087 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-binary-copy\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137137 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-kubelet\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137162 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-ovn\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-netns\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-var-lib-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137249 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137269 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-run-netns\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137271 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cni-binary-copy\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-k8s-cni-cncf-io\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137350 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-hostroot\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-etc-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw85p\" (UniqueName: \"kubernetes.io/projected/6889e015-f489-44ef-8bb1-91db789b1c98-kube-api-access-dw85p\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-system-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-etc-kubernetes\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbw56\" (UniqueName: \"kubernetes.io/projected/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-kube-api-access-lbw56\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137541 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cnibin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.138290 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-systemd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137600 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-system-cni-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-device-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137635 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137647 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-daemon-config\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137700 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-var-lib-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137734 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-etc-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137745 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-config\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137757 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cnibin\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137772 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cnibin\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137783 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-cni-binary-copy\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-hostroot\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137797 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137825 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-systemd\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137834 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-systemd-units\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137859 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-node-log\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137879 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-device-dir\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137884 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-os-release\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137909 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137931 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137966 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-etc-kubernetes\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.138017 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138016 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-system-cni-dir\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.138083 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:10.638064922 +0000 UTC m=+3.117125382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.137698 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-host-run-k8s-cni-cncf-io\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138237 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-system-cni-dir\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138289 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-run-openvswitch\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138316 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-cnibin\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/6889e015-f489-44ef-8bb1-91db789b1c98-etc-selinux\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-systemd-units\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.139765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138385 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/06d2c47d-8462-4dce-9f53-75d1bc58e09b-os-release\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.140363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138423 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/faf7353a-f06c-4cf6-bff3-cb589cb12d36-node-log\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.140363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-multus-daemon-config\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.140363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.138570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovnkube-config\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.140363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.139897 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/63814b2c-fc48-4715-9508-2357758d6f40-agent-certs\") pod \"konnectivity-agent-x62cp\" (UID: \"63814b2c-fc48-4715-9508-2357758d6f40\") " pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.140363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.140069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/faf7353a-f06c-4cf6-bff3-cb589cb12d36-ovn-node-metrics-cert\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.146383 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.146355 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cxzm\" (UniqueName: \"kubernetes.io/projected/faf7353a-f06c-4cf6-bff3-cb589cb12d36-kube-api-access-8cxzm\") pod \"ovnkube-node-xsgmv\" (UID: \"faf7353a-f06c-4cf6-bff3-cb589cb12d36\") " pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.146566 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.146546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfvz7\" (UniqueName: \"kubernetes.io/projected/06d2c47d-8462-4dce-9f53-75d1bc58e09b-kube-api-access-vfvz7\") pod \"multus-additional-cni-plugins-85m77\" (UID: \"06d2c47d-8462-4dce-9f53-75d1bc58e09b\") " pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.146666 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.146575 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m89fj\" (UniqueName: \"kubernetes.io/projected/8f1bd596-2ed1-4c85-a74c-752ac228c987-kube-api-access-m89fj\") pod \"iptables-alerter-w4ksc\" (UID: \"8f1bd596-2ed1-4c85-a74c-752ac228c987\") " pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.148558 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.148535 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbw56\" (UniqueName: \"kubernetes.io/projected/ca674252-ca1e-43ec-be6b-4c6abb3c9b88-kube-api-access-lbw56\") pod \"multus-55sp8\" (UID: \"ca674252-ca1e-43ec-be6b-4c6abb3c9b88\") " pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.148666 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.148613 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw85p\" (UniqueName: \"kubernetes.io/projected/6889e015-f489-44ef-8bb1-91db789b1c98-kube-api-access-dw85p\") pod \"aws-ebs-csi-driver-node-tfp22\" (UID: \"6889e015-f489-44ef-8bb1-91db789b1c98\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.231023 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.230992 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" Jun 16 19:49:10.240467 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.240430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-99zv5" Jun 16 19:49:10.247213 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.247189 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jm8mm" Jun 16 19:49:10.254923 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.254903 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:10.262579 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.262557 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w4ksc" Jun 16 19:49:10.269212 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.269191 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" Jun 16 19:49:10.277142 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.277122 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:10.282955 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.282902 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-85m77" Jun 16 19:49:10.287697 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.287679 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-55sp8" Jun 16 19:49:10.540024 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.539943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:10.540186 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.540113 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:10.540186 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.540185 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:11.540164709 +0000 UTC m=+4.019225181 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:10.640984 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.640954 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:10.640984 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.640992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:10.641198 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641103 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.641198 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641130 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:10.641198 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641157 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:10.641198 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641169 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.641198 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641159 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:11.641145213 +0000 UTC m=+4.120205672 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:10.641478 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:10.641221 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:11.641205172 +0000 UTC m=+4.120265633 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:10.840731 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.840681 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd96be0_3cef_435e_9749_b822ffee261e.slice/crio-b8e46ba9861db41f9347d56fa78c52b843d5af9bb86ee9a58fd5ec42e0b9eaa2 WatchSource:0}: Error finding container b8e46ba9861db41f9347d56fa78c52b843d5af9bb86ee9a58fd5ec42e0b9eaa2: Status 404 returned error can't find the container with id b8e46ba9861db41f9347d56fa78c52b843d5af9bb86ee9a58fd5ec42e0b9eaa2 Jun 16 19:49:10.842287 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.842259 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaf7353a_f06c_4cf6_bff3_cb589cb12d36.slice/crio-efd01d4e2a93378fab91c1e3cf79e57149d744d3408bbe344c4e7447a2f83653 WatchSource:0}: Error finding container efd01d4e2a93378fab91c1e3cf79e57149d744d3408bbe344c4e7447a2f83653: Status 404 returned error can't find the container with id efd01d4e2a93378fab91c1e3cf79e57149d744d3408bbe344c4e7447a2f83653 Jun 16 19:49:10.845412 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.845387 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod561341c8_d2e1_4a23_b607_94e68ba3476f.slice/crio-c7d9cd160c0f6f2cc1b927cd13f203e6d0dedd78fe041b19646b52057995ac5f WatchSource:0}: Error finding container c7d9cd160c0f6f2cc1b927cd13f203e6d0dedd78fe041b19646b52057995ac5f: Status 404 returned error can't find the container with id c7d9cd160c0f6f2cc1b927cd13f203e6d0dedd78fe041b19646b52057995ac5f Jun 16 19:49:10.846181 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.846159 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f1bd596_2ed1_4c85_a74c_752ac228c987.slice/crio-c38f8726aceec7130590ef409f9680ec9770e15cff712b119d75a825cf38f1ce WatchSource:0}: Error finding container c38f8726aceec7130590ef409f9680ec9770e15cff712b119d75a825cf38f1ce: Status 404 returned error can't find the container with id c38f8726aceec7130590ef409f9680ec9770e15cff712b119d75a825cf38f1ce Jun 16 19:49:10.847056 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.846975 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63814b2c_fc48_4715_9508_2357758d6f40.slice/crio-88a8a01a52c0e5834381bba4566d56b38bdae11f15c7fa6cb45ec1f3adf4519c WatchSource:0}: Error finding container 88a8a01a52c0e5834381bba4566d56b38bdae11f15c7fa6cb45ec1f3adf4519c: Status 404 returned error can't find the container with id 88a8a01a52c0e5834381bba4566d56b38bdae11f15c7fa6cb45ec1f3adf4519c Jun 16 19:49:10.848399 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.848274 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod783d336e_36c9_449a_a88c_4b277c73ed72.slice/crio-197ad2245112c7f5e47b874acaf98151a4d66360dd118573ad3a075dbf757e38 WatchSource:0}: Error finding container 197ad2245112c7f5e47b874acaf98151a4d66360dd118573ad3a075dbf757e38: Status 404 returned error can't find the container with id 197ad2245112c7f5e47b874acaf98151a4d66360dd118573ad3a075dbf757e38 Jun 16 19:49:10.849755 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:10.849728 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca674252_ca1e_43ec_be6b_4c6abb3c9b88.slice/crio-fae19d27f030229dff52f3d45e2dd6da195489bfcb421b71864e61bf801d75a4 WatchSource:0}: Error finding container fae19d27f030229dff52f3d45e2dd6da195489bfcb421b71864e61bf801d75a4: Status 404 returned error can't find the container with id fae19d27f030229dff52f3d45e2dd6da195489bfcb421b71864e61bf801d75a4 Jun 16 19:49:10.967628 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.967575 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:44:09 +0000 UTC" deadline="2027-12-23 18:07:27.632966143 +0000 UTC" Jun 16 19:49:10.967628 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:10.967624 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13318h18m16.66534614s" Jun 16 19:49:11.002592 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.002548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" event={"ID":"4eb95cf55887de53e5ea257c2ce412d4","Type":"ContainerStarted","Data":"47b0daaa90ad08c88b65a4c526381699ef376c0e95c6464a8fce60daf9676b8b"} Jun 16 19:49:11.005854 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.005826 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerStarted","Data":"6d51c18bf29d95d1b3d5ee5c89cd133c11b0ecefa37676721cd10ed0b11df96f"} Jun 16 19:49:11.007207 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.007184 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x62cp" event={"ID":"63814b2c-fc48-4715-9508-2357758d6f40","Type":"ContainerStarted","Data":"88a8a01a52c0e5834381bba4566d56b38bdae11f15c7fa6cb45ec1f3adf4519c"} Jun 16 19:49:11.008630 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.008606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" event={"ID":"561341c8-d2e1-4a23-b607-94e68ba3476f","Type":"ContainerStarted","Data":"c7d9cd160c0f6f2cc1b927cd13f203e6d0dedd78fe041b19646b52057995ac5f"} Jun 16 19:49:11.010221 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.010199 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4ksc" event={"ID":"8f1bd596-2ed1-4c85-a74c-752ac228c987","Type":"ContainerStarted","Data":"c38f8726aceec7130590ef409f9680ec9770e15cff712b119d75a825cf38f1ce"} Jun 16 19:49:11.011163 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.011142 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" event={"ID":"6889e015-f489-44ef-8bb1-91db789b1c98","Type":"ContainerStarted","Data":"c2d0d7baf1a89c9b11bfc19d948fe684c33118d1ea59e5fef88e68abfeb64102"} Jun 16 19:49:11.013422 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.013404 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55sp8" event={"ID":"ca674252-ca1e-43ec-be6b-4c6abb3c9b88","Type":"ContainerStarted","Data":"fae19d27f030229dff52f3d45e2dd6da195489bfcb421b71864e61bf801d75a4"} Jun 16 19:49:11.014450 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.014410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-99zv5" event={"ID":"783d336e-36c9-449a-a88c-4b277c73ed72","Type":"ContainerStarted","Data":"197ad2245112c7f5e47b874acaf98151a4d66360dd118573ad3a075dbf757e38"} Jun 16 19:49:11.016420 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.016399 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"efd01d4e2a93378fab91c1e3cf79e57149d744d3408bbe344c4e7447a2f83653"} Jun 16 19:49:11.017914 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.017891 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jm8mm" event={"ID":"3bd96be0-3cef-435e-9749-b822ffee261e","Type":"ContainerStarted","Data":"b8e46ba9861db41f9347d56fa78c52b843d5af9bb86ee9a58fd5ec42e0b9eaa2"} Jun 16 19:49:11.023460 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.023404 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-232.ec2.internal" podStartSLOduration=2.023393703 podStartE2EDuration="2.023393703s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:11.022867778 +0000 UTC m=+3.501928269" watchObservedRunningTime="2026-06-16 19:49:11.023393703 +0000 UTC m=+3.502454180" Jun 16 19:49:11.545154 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.545056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:11.545322 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.545235 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:11.545322 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.545300 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:13.545281773 +0000 UTC m=+6.024342256 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:11.646284 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.646217 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:11.646284 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.646282 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:11.646563 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.646425 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:11.646563 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.646558 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:11.646696 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.646575 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:11.646696 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.646589 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:11.646696 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.646648 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:13.646629311 +0000 UTC m=+6.125689770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:11.647060 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.647044 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:13.647026663 +0000 UTC m=+6.126087127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:11.967895 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.967726 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-15 19:44:09 +0000 UTC" deadline="2028-02-22 03:57:50.931481108 +0000 UTC" Jun 16 19:49:11.967895 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.967759 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14768h8m38.96372632s" Jun 16 19:49:11.991311 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.991280 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:11.991506 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.991408 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:11.991568 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.991512 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:11.991622 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.991598 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:11.991673 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:11.991664 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:11.991767 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:11.991745 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:12.032972 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:12.032936 2576 generic.go:356] "Generic (PLEG): container finished" podID="8f94d807c79eea6338eef3d4fdba8ae7" containerID="5e80bf2337ed73d57d43d720823466bdaa997663b4b4394b2b127f7b2927d1f0" exitCode=0 Jun 16 19:49:12.033877 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:12.033847 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" event={"ID":"8f94d807c79eea6338eef3d4fdba8ae7","Type":"ContainerDied","Data":"5e80bf2337ed73d57d43d720823466bdaa997663b4b4394b2b127f7b2927d1f0"} Jun 16 19:49:13.064046 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.064005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" event={"ID":"8f94d807c79eea6338eef3d4fdba8ae7","Type":"ContainerStarted","Data":"a5fefcca9ed37c2024f54394c98b6ec02801b03178e37ffc823daa92aea9e641"} Jun 16 19:49:13.083872 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.083553 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-232.ec2.internal" podStartSLOduration=4.083531393 podStartE2EDuration="4.083531393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:13.082515742 +0000 UTC m=+5.561576221" watchObservedRunningTime="2026-06-16 19:49:13.083531393 +0000 UTC m=+5.562591874" Jun 16 19:49:13.562584 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.562497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:13.562763 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.562703 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:13.562821 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.562773 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:17.562754168 +0000 UTC m=+10.041814626 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:13.663704 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.663652 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:13.663882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.663758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:13.663943 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.663905 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:13.663943 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.663926 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:13.663943 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.663938 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:13.664091 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.663997 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:17.663979618 +0000 UTC m=+10.143040079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:13.664411 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.664390 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:13.664511 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.664459 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:17.664430772 +0000 UTC m=+10.143491233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:13.991776 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.991698 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:13.991929 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.991828 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:13.992202 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.992186 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:13.992525 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.992278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:13.992525 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:13.992338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:13.992525 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:13.992396 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:15.989015 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:15.988980 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:15.989015 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:15.989004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:15.989494 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:15.989066 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:15.989494 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:15.989177 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:15.989494 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:15.989283 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:15.989494 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:15.989384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:17.598138 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.598034 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:17.598635 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.598201 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:17.598635 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.598274 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:25.598254469 +0000 UTC m=+18.077314934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.698659 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.698734 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698824 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698838 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698857 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698868 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698889 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:25.69887233 +0000 UTC m=+18.177932805 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:17.699084 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.698905 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:25.698895684 +0000 UTC m=+18.177956156 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.989606 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.989718 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.990857 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.990991 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:17.991057 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:17.991218 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:17.991126 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:19.989669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:19.989469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:19.989669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:19.989469 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:19.989669 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:19.989584 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:19.990213 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:19.989682 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:19.990213 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:19.989475 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:19.990213 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:19.989796 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:21.992331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:21.992303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:21.992331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:21.992333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:21.992834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:21.992303 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:21.992834 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:21.992401 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:21.992834 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:21.992525 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:21.992834 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:21.992613 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:23.989035 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:23.988997 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:23.989556 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:23.989046 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:23.989556 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:23.988996 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:23.989556 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:23.989138 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:23.989556 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:23.989196 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:23.989556 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:23.989274 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:25.663053 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.662975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:25.663461 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.663140 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:25.663461 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.663217 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:41.663195192 +0000 UTC m=+34.142255652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:25.764092 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.764059 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:25.764286 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.764115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:25.764286 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764243 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:25.764374 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764296 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:49:41.764281735 +0000 UTC m=+34.243342190 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:25.764374 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764245 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:25.764374 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764341 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:25.764374 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764354 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:25.764560 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.764398 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:49:41.76438634 +0000 UTC m=+34.243446813 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:25.989801 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.989718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:25.989953 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.989718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:25.989953 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.989849 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:25.989953 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.989922 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:25.989953 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:25.989731 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:25.990136 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:25.990039 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:27.990178 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:27.990141 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:27.990679 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:27.990246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:27.990679 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:27.990318 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:27.990679 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:27.990424 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:27.990679 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:27.990480 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:27.990679 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:27.990558 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:29.989063 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:29.988831 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:29.989728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:29.988843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:29.989728 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:29.989169 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:29.989728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:29.988898 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:29.989728 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:29.989225 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:29.989728 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:29.989331 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:30.100386 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.100292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:49:30.100619 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.100599 2576 generic.go:356] "Generic (PLEG): container finished" podID="faf7353a-f06c-4cf6-bff3-cb589cb12d36" containerID="bbbe8a61ec562de909f0ae5a577c0648432ecf5daf39bb73db1865dc3e9fe289" exitCode=1 Jun 16 19:49:30.100699 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.100673 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"fc0ca5aad80743f7396ff675d5c9272109ff80744b270e16747f045b7c0e39c5"} Jun 16 19:49:30.100816 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.100798 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerDied","Data":"bbbe8a61ec562de909f0ae5a577c0648432ecf5daf39bb73db1865dc3e9fe289"} Jun 16 19:49:30.100867 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.100844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"757316e91f7aaac7e8930050c09b241aa3c8befe992efe452a2100dc7158b3db"} Jun 16 19:49:30.102037 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.102009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jm8mm" event={"ID":"3bd96be0-3cef-435e-9749-b822ffee261e","Type":"ContainerStarted","Data":"1b741ebfd7e41bba46fdb281f1fb0039a8eaf6ffa298a768449a40b0198951a2"} Jun 16 19:49:30.103333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.103310 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="1500698bd02e323d5a347f599609e0332b41c8faeee2d2aac2d0b26874ec4dc8" exitCode=0 Jun 16 19:49:30.103453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.103381 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"1500698bd02e323d5a347f599609e0332b41c8faeee2d2aac2d0b26874ec4dc8"} Jun 16 19:49:30.104899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.104877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-x62cp" event={"ID":"63814b2c-fc48-4715-9508-2357758d6f40","Type":"ContainerStarted","Data":"c53978ea6f65ee0804fcec3feab482e016633f6e6af2848753dc75a893b114df"} Jun 16 19:49:30.106742 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.106720 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" event={"ID":"561341c8-d2e1-4a23-b607-94e68ba3476f","Type":"ContainerStarted","Data":"f034058931fe861c40aa472cd217a30d4f8e3d9be5d43b54c76993cd8a0679ea"} Jun 16 19:49:30.108205 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.108179 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" event={"ID":"6889e015-f489-44ef-8bb1-91db789b1c98","Type":"ContainerStarted","Data":"42d33ef627def0bf803bc68ac961ccfe34c452a2b5ede61d04acc900756b4c12"} Jun 16 19:49:30.109771 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.109736 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-55sp8" event={"ID":"ca674252-ca1e-43ec-be6b-4c6abb3c9b88","Type":"ContainerStarted","Data":"aa2ae7db5d15e5d24faf6c6384ccf354f642c8a767834407bfed5aa1e315b499"} Jun 16 19:49:30.111079 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.111058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-99zv5" event={"ID":"783d336e-36c9-449a-a88c-4b277c73ed72","Type":"ContainerStarted","Data":"f500d7b83b0ccb80faba4c035aceead9d2399a22d70c641ad1c3df9fce838bd2"} Jun 16 19:49:30.146291 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.146236 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vm8rq" podStartSLOduration=3.357484255 podStartE2EDuration="22.146216061s" totalImagesPullingTime="18.788731806s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:30.145283818 +0000 UTC m=+22.624344296" watchObservedRunningTime="2026-06-16 19:49:30.146216061 +0000 UTC m=+22.625276539" Jun 16 19:49:30.161713 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.161663 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jm8mm" podStartSLOduration=3.385287232 podStartE2EDuration="22.161647594s" totalImagesPullingTime="18.776360362s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:30.161416015 +0000 UTC m=+22.640476492" watchObservedRunningTime="2026-06-16 19:49:30.161647594 +0000 UTC m=+22.640708149" Jun 16 19:49:30.177921 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.177879 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-x62cp" podStartSLOduration=3.407734636 podStartE2EDuration="22.177859385s" totalImagesPullingTime="18.770124749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:30.177529771 +0000 UTC m=+22.656590252" watchObservedRunningTime="2026-06-16 19:49:30.177859385 +0000 UTC m=+22.656919863" Jun 16 19:49:30.215297 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.215244 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-99zv5" podStartSLOduration=3.429251248 podStartE2EDuration="22.215222143s" totalImagesPullingTime="18.785970895s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:30.195580621 +0000 UTC m=+22.674641101" watchObservedRunningTime="2026-06-16 19:49:30.215222143 +0000 UTC m=+22.694282643" Jun 16 19:49:30.215688 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:30.215649 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-55sp8" podStartSLOduration=3.384190251 podStartE2EDuration="22.21563527s" totalImagesPullingTime="18.831445019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:30.215040089 +0000 UTC m=+22.694100588" watchObservedRunningTime="2026-06-16 19:49:30.21563527 +0000 UTC m=+22.694695748" Jun 16 19:49:31.087055 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.087024 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:31.087564 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.087513 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:31.116413 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.116323 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:49:31.117459 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.116899 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"fea9f6c7e3058f1bec85c5b4fce243f9222f3bf3266a20100b04f37d1330b680"} Jun 16 19:49:31.117459 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.116984 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"dd8aff3c621824298cb36d36c6df73bd2535c39389dc349f3c1b16ce0dd177ce"} Jun 16 19:49:31.117459 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.117033 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"2c8f921d1a26641aabc03442af12a2dcd2e7be3d64b6955471200cb19f524c10"} Jun 16 19:49:31.118074 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.118044 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:31.118716 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.118539 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-x62cp" Jun 16 19:49:31.230415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.230215 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 16 19:49:31.989377 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.989138 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-16T19:49:31.230409893Z","UUID":"c40c55fe-9c20-4069-b932-06ad8eb4b320","Handler":null,"Name":"","Endpoint":""} Jun 16 19:49:31.989377 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.989346 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:31.989377 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.989350 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:31.989696 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:31.989352 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:31.989696 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:31.989483 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:31.989696 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:31.989618 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:31.989834 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:31.989729 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:32.001712 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:32.001680 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 16 19:49:32.001861 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:32.001726 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 16 19:49:32.120666 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:32.120632 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w4ksc" event={"ID":"8f1bd596-2ed1-4c85-a74c-752ac228c987","Type":"ContainerStarted","Data":"1f06704dea33551bf00ea78535060e8d8a7e60edf91bd9567e472a62410bbe2d"} Jun 16 19:49:32.122778 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:32.122745 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" event={"ID":"6889e015-f489-44ef-8bb1-91db789b1c98","Type":"ContainerStarted","Data":"079ce8b0b54c49cc10f2979f30be2b858158772531adc63738ba68dba86ad2f7"} Jun 16 19:49:32.141167 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:32.141114 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w4ksc" podStartSLOduration=5.369679844 podStartE2EDuration="24.141097617s" totalImagesPullingTime="18.771417773s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:32.140459633 +0000 UTC m=+24.619520141" watchObservedRunningTime="2026-06-16 19:49:32.141097617 +0000 UTC m=+24.620158095" Jun 16 19:49:33.126836 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.126800 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" event={"ID":"6889e015-f489-44ef-8bb1-91db789b1c98","Type":"ContainerStarted","Data":"7f0ea92d61d7cbcb45dbd9b997467c754905df9807da21719744a2af666f2aa1"} Jun 16 19:49:33.130116 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.130094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:49:33.130598 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.130570 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"cf9bb1b5fed021e9f8487ca443faefb4b13750dfb366ad2bc67c95af8dfb4b92"} Jun 16 19:49:33.151089 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.151037 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tfp22" podStartSLOduration=3.930961361 podStartE2EDuration="25.151021444s" totalImagesPullingTime="21.220060083s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:33.150574164 +0000 UTC m=+25.629634642" watchObservedRunningTime="2026-06-16 19:49:33.151021444 +0000 UTC m=+25.630081920" Jun 16 19:49:33.989180 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.989133 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:33.989351 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.989147 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:33.989351 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:33.989267 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:33.989351 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:33.989338 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:33.989577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:33.989375 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:33.989577 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:33.989459 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:35.138837 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.138660 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:49:35.139396 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.139211 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"b1902795be07bcbb2e285044f71e5747ab9b41ef57f7ea451df360515a21072c"} Jun 16 19:49:35.139487 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.139460 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:35.139748 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.139540 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:35.139748 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.139622 2576 scope.go:117] "RemoveContainer" containerID="bbbe8a61ec562de909f0ae5a577c0648432ecf5daf39bb73db1865dc3e9fe289" Jun 16 19:49:35.141136 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.141115 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="031e6928ceca1b41614fb2b1d881e420d9b458e852a8a13eb43308ee091bf36f" exitCode=0 Jun 16 19:49:35.141240 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.141146 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"031e6928ceca1b41614fb2b1d881e420d9b458e852a8a13eb43308ee091bf36f"} Jun 16 19:49:35.157277 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.157258 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:35.989510 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.989472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:35.989510 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.989496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:35.989754 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:35.989472 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:35.989754 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:35.989596 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:35.989754 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:35.989685 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:35.989898 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:35.989776 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:36.148860 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:36.148826 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:49:36.149225 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:36.149150 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" event={"ID":"faf7353a-f06c-4cf6-bff3-cb589cb12d36","Type":"ContainerStarted","Data":"28db76850983abdd2dac5914c913c9383becf5ef460158f4ae06916f1c72a1e1"} Jun 16 19:49:36.149407 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:36.149391 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:36.164474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:36.164450 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:49:36.190765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:36.190713 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" podStartSLOduration=9.375803626 podStartE2EDuration="28.190699209s" totalImagesPullingTime="18.814895583s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:36.190465025 +0000 UTC m=+28.669525522" watchObservedRunningTime="2026-06-16 19:49:36.190699209 +0000 UTC m=+28.669759687" Jun 16 19:49:37.153428 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:37.153398 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="16cd2f3a56664d0814e3b4b1a7ca95a44ab6ab32bf4a99af794837495cb85ea6" exitCode=0 Jun 16 19:49:37.153830 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:37.153472 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"16cd2f3a56664d0814e3b4b1a7ca95a44ab6ab32bf4a99af794837495cb85ea6"} Jun 16 19:49:37.990094 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:37.990045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:37.990282 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:37.990146 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:37.990282 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:37.990160 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:37.990282 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:37.990182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:37.990282 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:37.990246 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:37.990496 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:37.990328 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:39.160031 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:39.159832 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="110f9ee9fc585c96ae0bf70bd2f6070b726fc7aa7f04f983394089c28508e6d9" exitCode=0 Jun 16 19:49:39.160466 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:39.159907 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"110f9ee9fc585c96ae0bf70bd2f6070b726fc7aa7f04f983394089c28508e6d9"} Jun 16 19:49:39.989368 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:39.989335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:39.989368 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:39.989351 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:39.989617 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:39.989475 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:39.989617 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:39.989497 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:39.989617 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:39.989602 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:39.989748 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:39.989712 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:41.683679 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.681973 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:41.683679 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.682215 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:41.683679 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.682288 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs podName:cd618fa4-e361-4f36-bd6e-9585d5f29ea1 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:13.682268 +0000 UTC m=+66.161328458 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs") pod "network-metrics-daemon-rzff4" (UID: "cd618fa4-e361-4f36-bd6e-9585d5f29ea1") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 16 19:49:41.783455 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.783403 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:41.783633 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.783514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:41.783633 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783557 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:41.783633 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783628 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret podName:79c1f5ea-5f3f-496d-82df-ee92bc14dcb9 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:13.783612492 +0000 UTC m=+66.262672947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret") pod "global-pull-secret-syncer-6mfpr" (UID: "79c1f5ea-5f3f-496d-82df-ee92bc14dcb9") : object "kube-system"/"original-pull-secret" not registered Jun 16 19:49:41.783633 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783631 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 16 19:49:41.783821 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783650 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 16 19:49:41.783821 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783663 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pr8bz for pod openshift-network-diagnostics/network-check-target-cw776: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:41.783821 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.783717 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz podName:218e71c7-6084-4b59-a352-5b7e597a54ee nodeName:}" failed. No retries permitted until 2026-06-16 19:50:13.783700686 +0000 UTC m=+66.262761155 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pr8bz" (UniqueName: "kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz") pod "network-check-target-cw776" (UID: "218e71c7-6084-4b59-a352-5b7e597a54ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 16 19:49:41.989899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.989823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:41.989899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.989849 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:41.990114 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:41.989823 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:41.990114 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.989945 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:41.990114 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.990006 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:41.990265 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:41.990161 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:43.988827 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:43.988804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:43.989269 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:43.988903 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:43.989269 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:43.988942 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:43.989269 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:43.988945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:43.989269 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:43.989049 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:43.989269 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:43.989184 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:44.173262 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:44.173232 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="bf939668301abe3f9680a0f72b968a97fc665e68257290ae80437390a8bf4de4" exitCode=0 Jun 16 19:49:44.173417 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:44.173276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"bf939668301abe3f9680a0f72b968a97fc665e68257290ae80437390a8bf4de4"} Jun 16 19:49:45.179344 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.179311 2576 generic.go:356] "Generic (PLEG): container finished" podID="06d2c47d-8462-4dce-9f53-75d1bc58e09b" containerID="4e7bff1219d0cb7082049f41e0591beb7bec39ce5de8a44cd5559499a1943fa5" exitCode=0 Jun 16 19:49:45.179774 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.179374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerDied","Data":"4e7bff1219d0cb7082049f41e0591beb7bec39ce5de8a44cd5559499a1943fa5"} Jun 16 19:49:45.666032 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.665995 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mfpr"] Jun 16 19:49:45.666203 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.666137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:45.666261 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:45.666240 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:45.669738 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.669707 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cw776"] Jun 16 19:49:45.669895 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.669855 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:45.669984 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:45.669954 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:45.670375 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.670354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rzff4"] Jun 16 19:49:45.670501 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:45.670485 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:45.670613 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:45.670586 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:46.186063 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:46.185811 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-85m77" event={"ID":"06d2c47d-8462-4dce-9f53-75d1bc58e09b","Type":"ContainerStarted","Data":"995a3594d6392081ba5477b5781deeb4ca3a6baea3dedf4d05c2ac067c6ab8f7"} Jun 16 19:49:46.212092 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:46.212043 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-85m77" podStartSLOduration=7.866781792 podStartE2EDuration="38.212027183s" totalImagesPullingTime="30.345245391s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:46.211548222 +0000 UTC m=+38.690608720" watchObservedRunningTime="2026-06-16 19:49:46.212027183 +0000 UTC m=+38.691087660" Jun 16 19:49:46.988942 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:46.988851 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:46.989092 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:46.988957 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:47.992099 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:47.992071 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:47.992480 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:47.992168 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rzff4" podUID="cd618fa4-e361-4f36-bd6e-9585d5f29ea1" Jun 16 19:49:47.992480 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:47.992221 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:47.992480 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:47.992316 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6mfpr" podUID="79c1f5ea-5f3f-496d-82df-ee92bc14dcb9" Jun 16 19:49:48.989026 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:48.988994 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:48.989215 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:48.989093 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-cw776" podUID="218e71c7-6084-4b59-a352-5b7e597a54ee" Jun 16 19:49:49.878315 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.878288 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-232.ec2.internal" event="NodeReady" Jun 16 19:49:49.878715 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.878428 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 16 19:49:49.938149 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.938113 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75ff55c459-s46mv"] Jun 16 19:49:49.941660 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.941637 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:49.951601 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.951578 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 16 19:49:49.951727 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.951618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dm8ww\"" Jun 16 19:49:49.951790 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.951750 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 16 19:49:49.951851 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.951835 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 16 19:49:49.961831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.961805 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 16 19:49:49.971357 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.971325 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75ff55c459-s46mv"] Jun 16 19:49:49.991716 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.991689 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:49:49.991878 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.991843 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:49:49.994330 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.994310 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:49:49.994426 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.994351 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:49:49.994592 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:49.994581 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:49:50.041597 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041558 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-installation-pull-secrets\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-registry-certificates\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041624 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9d22114-5295-49ad-8e43-c928fde446b9-ca-trust-extracted\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041664 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-trusted-ca\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041731 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp2bp\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-kube-api-access-wp2bp\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041880 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-registry-tls\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041880 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041802 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-bound-sa-token\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.041880 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.041818 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-image-registry-private-configuration\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.142951 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.142867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-registry-tls\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.142951 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.142902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-bound-sa-token\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.142951 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.142926 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-image-registry-private-configuration\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143159 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143115 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-installation-pull-secrets\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143204 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143165 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-registry-certificates\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143204 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143191 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9d22114-5295-49ad-8e43-c928fde446b9-ca-trust-extracted\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143341 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143320 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-trusted-ca\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143399 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp2bp\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-kube-api-access-wp2bp\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.143618 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.143596 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9d22114-5295-49ad-8e43-c928fde446b9-ca-trust-extracted\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.144056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.144033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-registry-certificates\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.144520 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.144501 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9d22114-5295-49ad-8e43-c928fde446b9-trusted-ca\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.147017 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.146990 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-image-registry-private-configuration\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.147099 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.147021 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9d22114-5295-49ad-8e43-c928fde446b9-installation-pull-secrets\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.147238 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.147216 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-registry-tls\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.153798 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.153778 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-bound-sa-token\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.154140 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.154121 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp2bp\" (UniqueName: \"kubernetes.io/projected/f9d22114-5295-49ad-8e43-c928fde446b9-kube-api-access-wp2bp\") pod \"image-registry-75ff55c459-s46mv\" (UID: \"f9d22114-5295-49ad-8e43-c928fde446b9\") " pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.169860 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.169827 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-crcpl"] Jun 16 19:49:50.175221 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.175195 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvfvm"] Jun 16 19:49:50.175378 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.175321 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.177693 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.177630 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dg7s6\"" Jun 16 19:49:50.177693 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.177662 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 16 19:49:50.177887 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.177702 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 16 19:49:50.177887 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.177719 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 16 19:49:50.179194 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.179171 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.181364 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.181346 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 16 19:49:50.181538 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.181482 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 16 19:49:50.181712 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.181698 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 16 19:49:50.181803 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.181727 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27kct\"" Jun 16 19:49:50.181862 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.181844 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 16 19:49:50.186687 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.186656 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crcpl"] Jun 16 19:49:50.187527 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.187507 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvfvm"] Jun 16 19:49:50.195187 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.195162 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ndjxd"] Jun 16 19:49:50.198886 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.198866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.201116 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.201095 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 16 19:49:50.201116 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.201115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 16 19:49:50.201307 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.201195 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j9jnd\"" Jun 16 19:49:50.210456 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.210412 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ndjxd"] Jun 16 19:49:50.250445 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.250396 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:50.344921 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.344893 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-config-volume\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.345062 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.344928 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.345062 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.344953 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfkr9\" (UniqueName: \"kubernetes.io/projected/9fc86f03-b68c-4e5c-ae77-15e323efb287-kube-api-access-sfkr9\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.345062 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqfrw\" (UniqueName: \"kubernetes.io/projected/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-api-access-cqfrw\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.345062 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345054 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-tmp-dir\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.345209 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345089 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-metrics-tls\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.345209 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50de9a28-23ac-4ab3-8f97-69390134d16e-data-volume\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.345209 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345137 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50de9a28-23ac-4ab3-8f97-69390134d16e-crio-socket\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.345209 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345152 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50de9a28-23ac-4ab3-8f97-69390134d16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.345355 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345206 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fc86f03-b68c-4e5c-ae77-15e323efb287-cert\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.345355 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.345261 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5pdn\" (UniqueName: \"kubernetes.io/projected/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-kube-api-access-c5pdn\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.397544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.397465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75ff55c459-s46mv"] Jun 16 19:49:50.400738 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:50.400713 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d22114_5295_49ad_8e43_c928fde446b9.slice/crio-761cb277bc04bb56776e8fbf0aaa4141d4ddda2dd5d7cf0235a9fba07ebb74fa WatchSource:0}: Error finding container 761cb277bc04bb56776e8fbf0aaa4141d4ddda2dd5d7cf0235a9fba07ebb74fa: Status 404 returned error can't find the container with id 761cb277bc04bb56776e8fbf0aaa4141d4ddda2dd5d7cf0235a9fba07ebb74fa Jun 16 19:49:50.446594 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446567 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50de9a28-23ac-4ab3-8f97-69390134d16e-data-volume\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446594 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50de9a28-23ac-4ab3-8f97-69390134d16e-crio-socket\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446769 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50de9a28-23ac-4ab3-8f97-69390134d16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446769 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446711 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fc86f03-b68c-4e5c-ae77-15e323efb287-cert\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.446769 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446739 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/50de9a28-23ac-4ab3-8f97-69390134d16e-crio-socket\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446769 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446753 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5pdn\" (UniqueName: \"kubernetes.io/projected/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-kube-api-access-c5pdn\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446818 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-config-volume\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446847 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446871 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfkr9\" (UniqueName: \"kubernetes.io/projected/9fc86f03-b68c-4e5c-ae77-15e323efb287-kube-api-access-sfkr9\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446921 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqfrw\" (UniqueName: \"kubernetes.io/projected/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-api-access-cqfrw\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446930 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/50de9a28-23ac-4ab3-8f97-69390134d16e-data-volume\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.446965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-tmp-dir\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.447239 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.446990 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-metrics-tls\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.447609 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.447429 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-tmp-dir\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.447609 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.447522 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-config-volume\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.447747 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.447675 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.450055 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.449878 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-metrics-tls\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.450201 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.450182 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/50de9a28-23ac-4ab3-8f97-69390134d16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.450242 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.450219 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fc86f03-b68c-4e5c-ae77-15e323efb287-cert\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.457138 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.457113 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5pdn\" (UniqueName: \"kubernetes.io/projected/2d4be6fa-b16e-42de-a74e-a3f04bbadc92-kube-api-access-c5pdn\") pod \"dns-default-ndjxd\" (UID: \"2d4be6fa-b16e-42de-a74e-a3f04bbadc92\") " pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.457330 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.457308 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqfrw\" (UniqueName: \"kubernetes.io/projected/50de9a28-23ac-4ab3-8f97-69390134d16e-kube-api-access-cqfrw\") pod \"insights-runtime-extractor-zvfvm\" (UID: \"50de9a28-23ac-4ab3-8f97-69390134d16e\") " pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.457409 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.457395 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfkr9\" (UniqueName: \"kubernetes.io/projected/9fc86f03-b68c-4e5c-ae77-15e323efb287-kube-api-access-sfkr9\") pod \"ingress-canary-crcpl\" (UID: \"9fc86f03-b68c-4e5c-ae77-15e323efb287\") " pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.484978 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.484953 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-crcpl" Jun 16 19:49:50.491226 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.491194 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvfvm" Jun 16 19:49:50.506567 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.506542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:50.663115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.663082 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-crcpl"] Jun 16 19:49:50.666777 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:50.666744 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fc86f03_b68c_4e5c_ae77_15e323efb287.slice/crio-3995e1728cf63dde87279ed1e8c2898797997acbfb19263328f2cdb6c2a4dab4 WatchSource:0}: Error finding container 3995e1728cf63dde87279ed1e8c2898797997acbfb19263328f2cdb6c2a4dab4: Status 404 returned error can't find the container with id 3995e1728cf63dde87279ed1e8c2898797997acbfb19263328f2cdb6c2a4dab4 Jun 16 19:49:50.667419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.667326 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvfvm"] Jun 16 19:49:50.669892 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:50.669867 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50de9a28_23ac_4ab3_8f97_69390134d16e.slice/crio-b1cb8bf63238a76ef01f0eb051089981b71b54cb055cf9fda74436a0a1e24ed9 WatchSource:0}: Error finding container b1cb8bf63238a76ef01f0eb051089981b71b54cb055cf9fda74436a0a1e24ed9: Status 404 returned error can't find the container with id b1cb8bf63238a76ef01f0eb051089981b71b54cb055cf9fda74436a0a1e24ed9 Jun 16 19:49:50.685169 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.685137 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ndjxd"] Jun 16 19:49:50.688148 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:50.688119 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d4be6fa_b16e_42de_a74e_a3f04bbadc92.slice/crio-87fd0dd4f4f0ece365aa14b2d9327e0f3c25393f7b4772dbebc7ff29fda27a6a WatchSource:0}: Error finding container 87fd0dd4f4f0ece365aa14b2d9327e0f3c25393f7b4772dbebc7ff29fda27a6a: Status 404 returned error can't find the container with id 87fd0dd4f4f0ece365aa14b2d9327e0f3c25393f7b4772dbebc7ff29fda27a6a Jun 16 19:49:50.989826 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.989740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:49:50.992473 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.992452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 16 19:49:50.992562 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.992453 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 16 19:49:50.992712 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:50.992700 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:49:51.158983 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.158823 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8"] Jun 16 19:49:51.162407 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.162093 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:51.164884 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.164706 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 16 19:49:51.164884 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.164755 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6wbws\"" Jun 16 19:49:51.173424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.173390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8"] Jun 16 19:49:51.200056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.199994 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ndjxd" event={"ID":"2d4be6fa-b16e-42de-a74e-a3f04bbadc92","Type":"ContainerStarted","Data":"87fd0dd4f4f0ece365aa14b2d9327e0f3c25393f7b4772dbebc7ff29fda27a6a"} Jun 16 19:49:51.201631 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.201559 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crcpl" event={"ID":"9fc86f03-b68c-4e5c-ae77-15e323efb287","Type":"ContainerStarted","Data":"3995e1728cf63dde87279ed1e8c2898797997acbfb19263328f2cdb6c2a4dab4"} Jun 16 19:49:51.204075 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.203999 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvfvm" event={"ID":"50de9a28-23ac-4ab3-8f97-69390134d16e","Type":"ContainerStarted","Data":"b1cb8bf63238a76ef01f0eb051089981b71b54cb055cf9fda74436a0a1e24ed9"} Jun 16 19:49:51.207478 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.207430 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" event={"ID":"f9d22114-5295-49ad-8e43-c928fde446b9","Type":"ContainerStarted","Data":"acea9c2b3f552df381e56dab8dd9fb0499683bbfd8d871fa7b3b8ec6ddbdb6e4"} Jun 16 19:49:51.207600 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.207498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" event={"ID":"f9d22114-5295-49ad-8e43-c928fde446b9","Type":"ContainerStarted","Data":"761cb277bc04bb56776e8fbf0aaa4141d4ddda2dd5d7cf0235a9fba07ebb74fa"} Jun 16 19:49:51.208250 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.208229 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:49:51.232694 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.232630 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" podStartSLOduration=7.232607515 podStartE2EDuration="7.232607515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:51.232043094 +0000 UTC m=+43.711103573" watchObservedRunningTime="2026-06-16 19:49:51.232607515 +0000 UTC m=+43.711667998" Jun 16 19:49:51.357053 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.356965 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-kkwn8\" (UID: \"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:51.457950 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.457911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-kkwn8\" (UID: \"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:51.458163 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:51.458117 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jun 16 19:49:51.458232 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:49:51.458186 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates podName:ad63b7ca-39e5-43cf-a725-f5732d1f3e7a nodeName:}" failed. No retries permitted until 2026-06-16 19:49:51.958167459 +0000 UTC m=+44.437227920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates") pod "prometheus-operator-admission-webhook-5cf667749c-kkwn8" (UID: "ad63b7ca-39e5-43cf-a725-f5732d1f3e7a") : secret "prometheus-operator-admission-webhook-tls" not found Jun 16 19:49:51.963480 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.962611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-kkwn8\" (UID: \"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:51.967751 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:51.966890 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad63b7ca-39e5-43cf-a725-f5732d1f3e7a-tls-certificates\") pod \"prometheus-operator-admission-webhook-5cf667749c-kkwn8\" (UID: \"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:52.084109 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:52.084077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:52.250605 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:52.250534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8"] Jun 16 19:49:54.829923 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:49:54.829887 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad63b7ca_39e5_43cf_a725_f5732d1f3e7a.slice/crio-044edf70f322a2d20e4870793f83f0f73066764571c22f895278012363e3ccc8 WatchSource:0}: Error finding container 044edf70f322a2d20e4870793f83f0f73066764571c22f895278012363e3ccc8: Status 404 returned error can't find the container with id 044edf70f322a2d20e4870793f83f0f73066764571c22f895278012363e3ccc8 Jun 16 19:49:55.223208 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:55.223028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" event={"ID":"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a","Type":"ContainerStarted","Data":"044edf70f322a2d20e4870793f83f0f73066764571c22f895278012363e3ccc8"} Jun 16 19:49:56.227408 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:56.227377 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-crcpl" event={"ID":"9fc86f03-b68c-4e5c-ae77-15e323efb287","Type":"ContainerStarted","Data":"8fe5184e9c6abf331daf2306d4675a6e3cff87c29ffd325d33fac8ae4f90e1de"} Jun 16 19:49:57.233401 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.233369 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ndjxd" event={"ID":"2d4be6fa-b16e-42de-a74e-a3f04bbadc92","Type":"ContainerStarted","Data":"49f75d965a1e12380cf31830afb8b5df45e512e3c7723b8e44a8fc9bf100ab43"} Jun 16 19:49:57.233832 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.233421 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ndjxd" event={"ID":"2d4be6fa-b16e-42de-a74e-a3f04bbadc92","Type":"ContainerStarted","Data":"faaca398d465cc106cb8ad907eb132bda9e7dad46526c476b5627f858b8fde5f"} Jun 16 19:49:57.233832 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.233490 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ndjxd" Jun 16 19:49:57.235015 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.234987 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvfvm" event={"ID":"50de9a28-23ac-4ab3-8f97-69390134d16e","Type":"ContainerStarted","Data":"211de846180217af7091366f8ac3dfa6fcf77fa7540ced78966576357ca59f38"} Jun 16 19:49:57.236623 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.236531 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" event={"ID":"ad63b7ca-39e5-43cf-a725-f5732d1f3e7a","Type":"ContainerStarted","Data":"536e696ccfed2909e43a07e192b167d5ad724f651d21db083b3b5337a23dfd83"} Jun 16 19:49:57.257514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.257425 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ndjxd" podStartSLOduration=1.821949838 podStartE2EDuration="7.257410258s" totalImagesPullingTime="5.43546042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:57.257361033 +0000 UTC m=+49.736421524" watchObservedRunningTime="2026-06-16 19:49:57.257410258 +0000 UTC m=+49.736470713" Jun 16 19:49:57.285721 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.285666 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" podStartSLOduration=4.319375029 podStartE2EDuration="6.285650064s" totalImagesPullingTime="1.966275035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:57.284684433 +0000 UTC m=+49.763744946" watchObservedRunningTime="2026-06-16 19:49:57.285650064 +0000 UTC m=+49.764710519" Jun 16 19:49:57.318348 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:57.318295 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-crcpl" podStartSLOduration=1.861735381 podStartE2EDuration="7.318278511s" totalImagesPullingTime="5.45654313s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:49:57.317657498 +0000 UTC m=+49.796718000" watchObservedRunningTime="2026-06-16 19:49:57.318278511 +0000 UTC m=+49.797338989" Jun 16 19:49:58.241320 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:58.241133 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvfvm" event={"ID":"50de9a28-23ac-4ab3-8f97-69390134d16e","Type":"ContainerStarted","Data":"5116e6512c303a1276b9e9822260f689c255168b87086006faab846afb7ba551"} Jun 16 19:49:58.241783 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:58.241354 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:58.246189 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:58.246168 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5cf667749c-kkwn8" Jun 16 19:49:59.223840 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.223810 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj"] Jun 16 19:49:59.239318 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.239295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj"] Jun 16 19:49:59.239464 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.239395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.242878 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.242855 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 16 19:49:59.243256 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.242943 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ql6n4\"" Jun 16 19:49:59.243256 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.242950 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 16 19:49:59.243256 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.242982 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 16 19:49:59.243256 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.243042 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 16 19:49:59.243256 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.243104 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 16 19:49:59.317096 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.317059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.317258 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.317174 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.317312 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.317276 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.317358 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.317344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wzvt\" (UniqueName: \"kubernetes.io/projected/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-kube-api-access-7wzvt\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.417910 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.417872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.418095 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.417925 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.418095 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.417980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wzvt\" (UniqueName: \"kubernetes.io/projected/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-kube-api-access-7wzvt\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.418095 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.418042 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.418723 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.418701 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.422363 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.422338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.422508 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.422380 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.433163 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.433136 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wzvt\" (UniqueName: \"kubernetes.io/projected/6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3-kube-api-access-7wzvt\") pod \"prometheus-operator-864fcfc6f9-96nbj\" (UID: \"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:49:59.549207 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:49:59.549124 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" Jun 16 19:50:00.089901 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:00.089871 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj"] Jun 16 19:50:00.094169 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:00.093981 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8b94cd_b9a7_49ac_b5b9_3096786d4bb3.slice/crio-f442fbbc090d53c6e247230193db5cf280de9cc64077f17dffa5991929fdcede WatchSource:0}: Error finding container f442fbbc090d53c6e247230193db5cf280de9cc64077f17dffa5991929fdcede: Status 404 returned error can't find the container with id f442fbbc090d53c6e247230193db5cf280de9cc64077f17dffa5991929fdcede Jun 16 19:50:00.248881 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:00.248806 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" event={"ID":"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3","Type":"ContainerStarted","Data":"f442fbbc090d53c6e247230193db5cf280de9cc64077f17dffa5991929fdcede"} Jun 16 19:50:01.253738 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:01.253707 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvfvm" event={"ID":"50de9a28-23ac-4ab3-8f97-69390134d16e","Type":"ContainerStarted","Data":"649da01c4feddcf4a8c3a1fdd76e8f1b782649ae1aa6470a8f20ecf7ad312bb4"} Jun 16 19:50:01.281481 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:01.281388 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvfvm" podStartSLOduration=1.8629246259999999 podStartE2EDuration="11.281363316s" totalImagesPullingTime="9.41843869s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:01.276483885 +0000 UTC m=+53.755544364" watchObservedRunningTime="2026-06-16 19:50:01.281363316 +0000 UTC m=+53.760423789" Jun 16 19:50:02.258570 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:02.258527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" event={"ID":"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3","Type":"ContainerStarted","Data":"97af6bfa8628b0299cd761ac15b8ec9d94b9a7fe8b4f6b47410d9d876fd61084"} Jun 16 19:50:02.259014 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:02.258594 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" event={"ID":"6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3","Type":"ContainerStarted","Data":"80bd1b42671914bdad86c7e1d8fc7c15a49db2b993c35f231100c0e941a2d7bd"} Jun 16 19:50:02.280595 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:02.280538 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-96nbj" podStartSLOduration=1.495178846 podStartE2EDuration="3.280520897s" totalImagesPullingTime="1.785342051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:02.278817595 +0000 UTC m=+54.757878073" watchObservedRunningTime="2026-06-16 19:50:02.280520897 +0000 UTC m=+54.759581374" Jun 16 19:50:04.593359 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.593326 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc"] Jun 16 19:50:04.613769 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.613740 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc"] Jun 16 19:50:04.613923 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.613789 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5"] Jun 16 19:50:04.613996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.613929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.616376 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.616342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 16 19:50:04.616376 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.616358 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 16 19:50:04.616376 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.616352 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-sqsl2\"" Jun 16 19:50:04.639778 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.639749 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-kwwjv"] Jun 16 19:50:04.639917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.639868 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.642216 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.642197 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 16 19:50:04.642492 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.642478 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k8fh5\"" Jun 16 19:50:04.642571 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.642482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 16 19:50:04.642611 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.642583 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 16 19:50:04.656988 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.656963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657098 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657000 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.657098 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657022 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chxss\" (UniqueName: \"kubernetes.io/projected/8726b13c-caa6-45f0-b887-15c9c1d33726-kube-api-access-chxss\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.657098 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657051 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffszd\" (UniqueName: \"kubernetes.io/projected/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-api-access-ffszd\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657216 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657119 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657216 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657162 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8726b13c-caa6-45f0-b887-15c9c1d33726-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.657216 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657177 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657309 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657248 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657309 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657277 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.657309 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.657297 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.664050 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.664030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5"] Jun 16 19:50:04.664167 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.664151 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.666648 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.666619 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 16 19:50:04.666648 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.666623 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 16 19:50:04.666831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.666711 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xndj5\"" Jun 16 19:50:04.666831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.666720 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 16 19:50:04.758271 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758229 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-wtmp\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758271 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-metrics-client-ca\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758334 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-tls\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758359 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758382 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-root\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758453 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.758557 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758535 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hzmx\" (UniqueName: \"kubernetes.io/projected/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-kube-api-access-6hzmx\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758639 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758691 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chxss\" (UniqueName: \"kubernetes.io/projected/8726b13c-caa6-45f0-b887-15c9c1d33726-kube-api-access-chxss\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758727 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-textfile\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758816 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffszd\" (UniqueName: \"kubernetes.io/projected/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-api-access-ffszd\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:50:04.758727 2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.758882 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758871 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-sys\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.759274 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:50:04.758922 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls podName:8726b13c-caa6-45f0-b887-15c9c1d33726 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:05.258902891 +0000 UTC m=+57.737963347 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-mb8vc" (UID: "8726b13c-caa6-45f0-b887-15c9c1d33726") : secret "openshift-state-metrics-tls" not found Jun 16 19:50:04.759274 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8726b13c-caa6-45f0-b887-15c9c1d33726-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.759274 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.758969 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.759274 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.759166 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.759658 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.759628 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.759821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.759802 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8726b13c-caa6-45f0-b887-15c9c1d33726-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.759917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.759892 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.762512 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.762489 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.762512 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.762499 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.762635 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.762537 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.773584 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.773562 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chxss\" (UniqueName: \"kubernetes.io/projected/8726b13c-caa6-45f0-b887-15c9c1d33726-kube-api-access-chxss\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:04.774495 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.774471 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffszd\" (UniqueName: \"kubernetes.io/projected/c4c25d88-ece2-45e1-bae0-2fbc963d08cc-kube-api-access-ffszd\") pod \"kube-state-metrics-678bc549d7-rr5r5\" (UID: \"c4c25d88-ece2-45e1-bae0-2fbc963d08cc\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.859356 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859265 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-wtmp\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859356 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-metrics-client-ca\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859356 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859314 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-tls\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859356 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859332 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859468 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-root\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859477 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-wtmp\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859534 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859583 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-root\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hzmx\" (UniqueName: \"kubernetes.io/projected/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-kube-api-access-6hzmx\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859890 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859699 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-textfile\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859941 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859905 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-sys\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.859996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.859952 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-textfile\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.860052 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.860028 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-metrics-client-ca\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.860105 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.860032 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-accelerators-collector-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.860105 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.860069 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-sys\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.861699 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.861679 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.861699 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.861704 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-node-exporter-tls\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.870478 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.870455 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hzmx\" (UniqueName: \"kubernetes.io/projected/dd4ca699-eab1-4c4a-beb1-8bb76650ee34-kube-api-access-6hzmx\") pod \"node-exporter-kwwjv\" (UID: \"dd4ca699-eab1-4c4a-beb1-8bb76650ee34\") " pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:04.948512 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.948473 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" Jun 16 19:50:04.972405 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:04.972380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-kwwjv" Jun 16 19:50:05.008820 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:05.008795 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4ca699_eab1_4c4a_beb1_8bb76650ee34.slice/crio-4cdc4826515ecb593f04903f1c0a4a0869ab71414af888d53e272eddb65a56d1 WatchSource:0}: Error finding container 4cdc4826515ecb593f04903f1c0a4a0869ab71414af888d53e272eddb65a56d1: Status 404 returned error can't find the container with id 4cdc4826515ecb593f04903f1c0a4a0869ab71414af888d53e272eddb65a56d1 Jun 16 19:50:05.103879 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.103844 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5"] Jun 16 19:50:05.106993 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:05.106970 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c25d88_ece2_45e1_bae0_2fbc963d08cc.slice/crio-ab2e125ba7f4a98aa627c997ffd49b37b025a2c3b4d86ac67cdd104c553bfd6a WatchSource:0}: Error finding container ab2e125ba7f4a98aa627c997ffd49b37b025a2c3b4d86ac67cdd104c553bfd6a: Status 404 returned error can't find the container with id ab2e125ba7f4a98aa627c997ffd49b37b025a2c3b4d86ac67cdd104c553bfd6a Jun 16 19:50:05.263112 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.263070 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:05.265378 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.265358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8726b13c-caa6-45f0-b887-15c9c1d33726-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-mb8vc\" (UID: \"8726b13c-caa6-45f0-b887-15c9c1d33726\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:05.268685 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.268660 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwwjv" event={"ID":"dd4ca699-eab1-4c4a-beb1-8bb76650ee34","Type":"ContainerStarted","Data":"4cdc4826515ecb593f04903f1c0a4a0869ab71414af888d53e272eddb65a56d1"} Jun 16 19:50:05.269587 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.269568 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" event={"ID":"c4c25d88-ece2-45e1-bae0-2fbc963d08cc","Type":"ContainerStarted","Data":"ab2e125ba7f4a98aa627c997ffd49b37b025a2c3b4d86ac67cdd104c553bfd6a"} Jun 16 19:50:05.523963 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.523927 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" Jun 16 19:50:05.696804 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.696768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc"] Jun 16 19:50:05.699728 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:05.699696 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8726b13c_caa6_45f0_b887_15c9c1d33726.slice/crio-f57a7374b323fb4de3fd16750399923b2d06ffd12dbd826596c0e8716713252b WatchSource:0}: Error finding container f57a7374b323fb4de3fd16750399923b2d06ffd12dbd826596c0e8716713252b: Status 404 returned error can't find the container with id f57a7374b323fb4de3fd16750399923b2d06ffd12dbd826596c0e8716713252b Jun 16 19:50:05.714642 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.714615 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:50:05.735521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.734885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:50:05.735521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.735101 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.738427 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.738196 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6shch\"" Jun 16 19:50:05.738427 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.738198 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 16 19:50:05.738427 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.738294 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 16 19:50:05.738819 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.738768 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 16 19:50:05.739051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.739027 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 16 19:50:05.739515 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.739333 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 16 19:50:05.739515 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.739367 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 16 19:50:05.739664 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.739592 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 16 19:50:05.740194 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.739895 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 16 19:50:05.740194 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.740088 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766779 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766813 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766852 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766899 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766943 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thrzq\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.766971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767001 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767035 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767074 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767120 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767149 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.767424 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.767221 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868185 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868185 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868189 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868417 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868211 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868417 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868417 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868408 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868512 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868556 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868719 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868719 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868607 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868719 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868646 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868719 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:50:05.868671 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle podName:a930c831-89ec-40c5-8b58-074c8e237828 nodeName:}" failed. No retries permitted until 2026-06-16 19:50:06.368646326 +0000 UTC m=+58.847706804 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "a930c831-89ec-40c5-8b58-074c8e237828") : configmap references non-existent config key: ca-bundle.crt Jun 16 19:50:05.868935 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.868935 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.868779 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thrzq\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.869051 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.869025 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.870335 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.870314 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.871544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.871490 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.872098 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.872058 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.872199 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.872129 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.872773 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.872750 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.872878 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.872857 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.873143 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.873079 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.873348 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.873328 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.873496 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.873472 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.874704 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.874687 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:05.881124 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:05.881102 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thrzq\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:06.275228 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.275193 2576 generic.go:356] "Generic (PLEG): container finished" podID="dd4ca699-eab1-4c4a-beb1-8bb76650ee34" containerID="ef3f15acf5435786c7835c7b6cc87d3eed5d252c432f70cb5f0f7312e7644c28" exitCode=0 Jun 16 19:50:06.275387 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.275288 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwwjv" event={"ID":"dd4ca699-eab1-4c4a-beb1-8bb76650ee34","Type":"ContainerDied","Data":"ef3f15acf5435786c7835c7b6cc87d3eed5d252c432f70cb5f0f7312e7644c28"} Jun 16 19:50:06.277453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.277413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" event={"ID":"8726b13c-caa6-45f0-b887-15c9c1d33726","Type":"ContainerStarted","Data":"8c475f17b1bcf871d4d91459fea171030c27d1a84facb612609b1282f6816a0e"} Jun 16 19:50:06.277550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.277476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" event={"ID":"8726b13c-caa6-45f0-b887-15c9c1d33726","Type":"ContainerStarted","Data":"17283e16c4996ab02e5a4a576e4904729d160c2ec81f4670892ebed08638cded"} Jun 16 19:50:06.277550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.277508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" event={"ID":"8726b13c-caa6-45f0-b887-15c9c1d33726","Type":"ContainerStarted","Data":"f57a7374b323fb4de3fd16750399923b2d06ffd12dbd826596c0e8716713252b"} Jun 16 19:50:06.373152 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.373056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:06.373942 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.373918 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:06.657611 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.657589 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:50:06.762781 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.762730 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-8bd545db9-b4zz9"] Jun 16 19:50:06.766376 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.766040 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.769927 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.769901 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 16 19:50:06.770774 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.770583 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 16 19:50:06.770774 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.770624 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 16 19:50:06.770774 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.770702 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fgem21dn64ocv\"" Jun 16 19:50:06.770996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.770921 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pt229\"" Jun 16 19:50:06.770996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.770947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 16 19:50:06.771124 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.771102 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 16 19:50:06.783559 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.783475 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8bd545db9-b4zz9"] Jun 16 19:50:06.832509 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.832486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:50:06.834260 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:06.834235 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda930c831_89ec_40c5_8b58_074c8e237828.slice/crio-e6a375b6e9ca8c6441c518366fe36fb023bbf81a0b5fd2273ca05ee156cd7a21 WatchSource:0}: Error finding container e6a375b6e9ca8c6441c518366fe36fb023bbf81a0b5fd2273ca05ee156cd7a21: Status 404 returned error can't find the container with id e6a375b6e9ca8c6441c518366fe36fb023bbf81a0b5fd2273ca05ee156cd7a21 Jun 16 19:50:06.877794 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877677 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.877794 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877768 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877812 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877851 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877878 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-grpc-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877931 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.877972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5qj8\" (UniqueName: \"kubernetes.io/projected/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-kube-api-access-w5qj8\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.878009 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.878006 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-metrics-client-ca\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979077 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979035 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979243 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979243 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979243 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979155 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979243 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979180 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-grpc-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979243 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979226 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979423 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979256 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5qj8\" (UniqueName: \"kubernetes.io/projected/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-kube-api-access-w5qj8\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.979423 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.979283 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-metrics-client-ca\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.980094 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.980045 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-metrics-client-ca\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.982254 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.982190 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.982711 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.982685 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.982818 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.982751 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.983030 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.982987 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-grpc-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.983460 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.983413 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.983598 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.983571 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-secret-thanos-querier-tls\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:06.989604 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:06.989570 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5qj8\" (UniqueName: \"kubernetes.io/projected/59f41e39-61ad-4da7-8d92-bb2a3b75f04f-kube-api-access-w5qj8\") pod \"thanos-querier-8bd545db9-b4zz9\" (UID: \"59f41e39-61ad-4da7-8d92-bb2a3b75f04f\") " pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:07.090949 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.090914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:07.241674 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.241637 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-8bd545db9-b4zz9"] Jun 16 19:50:07.243711 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.243693 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ndjxd" Jun 16 19:50:07.285002 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.284905 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwwjv" event={"ID":"dd4ca699-eab1-4c4a-beb1-8bb76650ee34","Type":"ContainerStarted","Data":"ffdea19b00c9d5cefa822c8540a01777da6beea656f23ed21ebc9845585a7846"} Jun 16 19:50:07.285002 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.284964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-kwwjv" event={"ID":"dd4ca699-eab1-4c4a-beb1-8bb76650ee34","Type":"ContainerStarted","Data":"63cd15246802f27900f1ac49818360b52a6d9f5bf8cbba3f33fbb996c08b0b33"} Jun 16 19:50:07.287638 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.287608 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" event={"ID":"c4c25d88-ece2-45e1-bae0-2fbc963d08cc","Type":"ContainerStarted","Data":"8ed182da2965e4f96442ac1b91f9a138b0a5b2f2c9fa30471676914680d9adf2"} Jun 16 19:50:07.287781 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.287671 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" event={"ID":"c4c25d88-ece2-45e1-bae0-2fbc963d08cc","Type":"ContainerStarted","Data":"630a64dbdccee33578e066eb6fcfcd13229dd4491bcbc940b59137fbf89bf810"} Jun 16 19:50:07.287781 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.287700 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" event={"ID":"c4c25d88-ece2-45e1-bae0-2fbc963d08cc","Type":"ContainerStarted","Data":"cbeca72b13b9d1ddc4d10850c7c3c226708ca3f1cd647b7e7c64d72cf8e357b1"} Jun 16 19:50:07.289139 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.289113 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"e6a375b6e9ca8c6441c518366fe36fb023bbf81a0b5fd2273ca05ee156cd7a21"} Jun 16 19:50:07.313030 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.312959 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-kwwjv" podStartSLOduration=2.194715968 podStartE2EDuration="3.312938221s" totalImagesPullingTime="1.04315705s" totalInitContainerRuntime="75.065203ms" isStatefulPod=true podCreationTimestamp="2026-06-16 19:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:07.311804015 +0000 UTC m=+59.790864494" watchObservedRunningTime="2026-06-16 19:50:07.312938221 +0000 UTC m=+59.791998701" Jun 16 19:50:07.332910 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:07.332882 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59f41e39_61ad_4da7_8d92_bb2a3b75f04f.slice/crio-d204845a943335eafa56736b85455a66018d84085ac8662fe86a1f802be6ac73 WatchSource:0}: Error finding container d204845a943335eafa56736b85455a66018d84085ac8662fe86a1f802be6ac73: Status 404 returned error can't find the container with id d204845a943335eafa56736b85455a66018d84085ac8662fe86a1f802be6ac73 Jun 16 19:50:07.346346 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:07.346301 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-rr5r5" podStartSLOduration=1.914229831 podStartE2EDuration="3.346283808s" totalImagesPullingTime="1.432053977s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:07.345721781 +0000 UTC m=+59.824782291" watchObservedRunningTime="2026-06-16 19:50:07.346283808 +0000 UTC m=+59.825344286" Jun 16 19:50:08.167766 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.167734 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xsgmv" Jun 16 19:50:08.296010 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.295935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" event={"ID":"8726b13c-caa6-45f0-b887-15c9c1d33726","Type":"ContainerStarted","Data":"b5ca647831ce6bf54e1f5dcad17e85e8fac97e388abb84e872682e34b79f02f7"} Jun 16 19:50:08.297696 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.297664 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9" exitCode=0 Jun 16 19:50:08.297842 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.297748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9"} Jun 16 19:50:08.299160 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.299132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"d204845a943335eafa56736b85455a66018d84085ac8662fe86a1f802be6ac73"} Jun 16 19:50:08.316270 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.316224 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-mb8vc" podStartSLOduration=3.047345299 podStartE2EDuration="4.316208089s" totalImagesPullingTime="1.26886279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:08.315771046 +0000 UTC m=+60.794831544" watchObservedRunningTime="2026-06-16 19:50:08.316208089 +0000 UTC m=+60.795268567" Jun 16 19:50:08.936210 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.936179 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-644967dcb9-b6lww"] Jun 16 19:50:08.938513 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.938492 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.941369 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.941345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 16 19:50:08.942949 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.942647 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 16 19:50:08.942949 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.942659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 16 19:50:08.942949 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.942754 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-2cnveqapjc6eb\"" Jun 16 19:50:08.942949 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.942880 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ngjmj\"" Jun 16 19:50:08.943199 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.943179 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 16 19:50:08.955403 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.955362 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644967dcb9-b6lww"] Jun 16 19:50:08.996414 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996264 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-metrics-server-audit-profiles\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996414 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wkwb\" (UniqueName: \"kubernetes.io/projected/cc941021-d5f6-4bc8-9b76-633af5319ff9-kube-api-access-4wkwb\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996414 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996389 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-client-certs\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996726 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996522 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996726 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996566 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-tls\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996726 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996592 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc941021-d5f6-4bc8-9b76-633af5319ff9-audit-log\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:08.996726 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:08.996621 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-client-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.097926 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.097883 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wkwb\" (UniqueName: \"kubernetes.io/projected/cc941021-d5f6-4bc8-9b76-633af5319ff9-kube-api-access-4wkwb\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098153 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.097943 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-client-certs\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098153 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098153 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098040 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-tls\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098153 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098063 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc941021-d5f6-4bc8-9b76-633af5319ff9-audit-log\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098359 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098232 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-client-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098359 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098315 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-metrics-server-audit-profiles\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098883 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098861 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/cc941021-d5f6-4bc8-9b76-633af5319ff9-audit-log\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.098883 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.098874 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.099271 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.099250 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/cc941021-d5f6-4bc8-9b76-633af5319ff9-metrics-server-audit-profiles\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.101342 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.101311 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-tls\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.101481 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.101458 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-client-ca-bundle\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.102133 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.102108 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/cc941021-d5f6-4bc8-9b76-633af5319ff9-secret-metrics-server-client-certs\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.109287 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.109241 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wkwb\" (UniqueName: \"kubernetes.io/projected/cc941021-d5f6-4bc8-9b76-633af5319ff9-kube-api-access-4wkwb\") pod \"metrics-server-644967dcb9-b6lww\" (UID: \"cc941021-d5f6-4bc8-9b76-633af5319ff9\") " pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.249764 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.249675 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:09.391452 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.391396 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb"] Jun 16 19:50:09.394231 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.394206 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.397254 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.396878 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 16 19:50:09.397254 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.397115 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-72tnq\"" Jun 16 19:50:09.404923 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.404829 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb"] Jun 16 19:50:09.502510 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.502413 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj2q6\" (UniqueName: \"kubernetes.io/projected/0d367536-b292-416b-baf3-5174073df7bc-kube-api-access-vj2q6\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.502673 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.502532 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d367536-b292-416b-baf3-5174073df7bc-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.603809 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.603584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj2q6\" (UniqueName: \"kubernetes.io/projected/0d367536-b292-416b-baf3-5174073df7bc-kube-api-access-vj2q6\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.603809 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.603689 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d367536-b292-416b-baf3-5174073df7bc-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.606810 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.606609 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0d367536-b292-416b-baf3-5174073df7bc-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.620250 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.620171 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-644967dcb9-b6lww"] Jun 16 19:50:09.623558 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.623529 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj2q6\" (UniqueName: \"kubernetes.io/projected/0d367536-b292-416b-baf3-5174073df7bc-kube-api-access-vj2q6\") pod \"monitoring-plugin-589576dfc7-h7qxb\" (UID: \"0d367536-b292-416b-baf3-5174073df7bc\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.624732 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:09.624704 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc941021_d5f6_4bc8_9b76_633af5319ff9.slice/crio-537ceb98a39fe6c60fa791881f2cdc8c0fd1782d29de2206e3282321f545005f WatchSource:0}: Error finding container 537ceb98a39fe6c60fa791881f2cdc8c0fd1782d29de2206e3282321f545005f: Status 404 returned error can't find the container with id 537ceb98a39fe6c60fa791881f2cdc8c0fd1782d29de2206e3282321f545005f Jun 16 19:50:09.676487 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.676459 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-9cnsn"] Jun 16 19:50:09.680365 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.680337 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:09.686824 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.686739 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 16 19:50:09.687739 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.687713 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-whcs5\"" Jun 16 19:50:09.688221 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.688168 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 16 19:50:09.697479 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.697397 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-9cnsn"] Jun 16 19:50:09.704829 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.704801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5kqj\" (UniqueName: \"kubernetes.io/projected/e949bae5-818c-49ff-b473-dd35ef21398d-kube-api-access-s5kqj\") pod \"downloads-694c955b9-9cnsn\" (UID: \"e949bae5-818c-49ff-b473-dd35ef21398d\") " pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:09.708834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.708814 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:09.806279 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.806197 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5kqj\" (UniqueName: \"kubernetes.io/projected/e949bae5-818c-49ff-b473-dd35ef21398d-kube-api-access-s5kqj\") pod \"downloads-694c955b9-9cnsn\" (UID: \"e949bae5-818c-49ff-b473-dd35ef21398d\") " pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:09.817029 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:09.816998 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5kqj\" (UniqueName: \"kubernetes.io/projected/e949bae5-818c-49ff-b473-dd35ef21398d-kube-api-access-s5kqj\") pod \"downloads-694c955b9-9cnsn\" (UID: \"e949bae5-818c-49ff-b473-dd35ef21398d\") " pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:10.002879 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.002847 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:10.212934 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.212870 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb"] Jun 16 19:50:10.219342 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:10.219145 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d367536_b292_416b_baf3_5174073df7bc.slice/crio-a76dad12184cad7708e98789689ec0faf6466e4f6dfaa40fc45613568f539779 WatchSource:0}: Error finding container a76dad12184cad7708e98789689ec0faf6466e4f6dfaa40fc45613568f539779: Status 404 returned error can't find the container with id a76dad12184cad7708e98789689ec0faf6466e4f6dfaa40fc45613568f539779 Jun 16 19:50:10.233066 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.232969 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-9cnsn"] Jun 16 19:50:10.237723 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:10.237686 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode949bae5_818c_49ff_b473_dd35ef21398d.slice/crio-9014600a38660183c9a5e8dcb37a1ffec2f1b6efd44c0e488428ff56ad037508 WatchSource:0}: Error finding container 9014600a38660183c9a5e8dcb37a1ffec2f1b6efd44c0e488428ff56ad037508: Status 404 returned error can't find the container with id 9014600a38660183c9a5e8dcb37a1ffec2f1b6efd44c0e488428ff56ad037508 Jun 16 19:50:10.309280 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.309248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-9cnsn" event={"ID":"e949bae5-818c-49ff-b473-dd35ef21398d","Type":"ContainerStarted","Data":"9014600a38660183c9a5e8dcb37a1ffec2f1b6efd44c0e488428ff56ad037508"} Jun 16 19:50:10.310813 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.310783 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" event={"ID":"0d367536-b292-416b-baf3-5174073df7bc","Type":"ContainerStarted","Data":"a76dad12184cad7708e98789689ec0faf6466e4f6dfaa40fc45613568f539779"} Jun 16 19:50:10.312701 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.312646 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" event={"ID":"cc941021-d5f6-4bc8-9b76-633af5319ff9","Type":"ContainerStarted","Data":"537ceb98a39fe6c60fa791881f2cdc8c0fd1782d29de2206e3282321f545005f"} Jun 16 19:50:10.316234 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.316100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f"} Jun 16 19:50:10.316234 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.316175 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07"} Jun 16 19:50:10.320202 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.320116 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"5bca3cf3938270443dd3635716f0b15c4e4473016056d9294b0d968d86f9979e"} Jun 16 19:50:10.320202 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.320188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"9f96a8cc8c9920337a204ac04cecf283fc2880746e8b14fd444842b7496a4ada"} Jun 16 19:50:10.320461 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:10.320232 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"9b291d061368087ec1144f8014bebf50c4af0ad939f54e79f73088edd070d3e4"} Jun 16 19:50:11.101310 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.100705 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:50:11.104945 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.104918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.107681 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.107512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2p8fm\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.113236 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-atbf4ims3gjjj\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.113851 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.114086 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.114408 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.114631 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 16 19:50:11.115834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.114849 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 16 19:50:11.120842 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.120777 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 16 19:50:11.121161 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.121127 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 16 19:50:11.121352 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.121332 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 16 19:50:11.121576 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.121548 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 16 19:50:11.121784 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.121753 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 16 19:50:11.122013 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.121993 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 16 19:50:11.128238 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.124994 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 16 19:50:11.128238 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.128093 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 16 19:50:11.130236 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.130052 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 16 19:50:11.130641 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.130555 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:50:11.228875 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.228811 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.228875 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.228862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229120 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.228973 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229120 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229041 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229120 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229081 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzvxj\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229215 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229140 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229215 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229215 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229225 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229255 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229279 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229331 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229313 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229533 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229533 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229533 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229405 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229533 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229430 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229533 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229501 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229779 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229590 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229779 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.229779 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.229728 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336335 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336423 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336482 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336544 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.336800 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.336589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.339528 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.339497 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.339669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.339591 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.339730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.339701 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.339936 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.339916 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340190 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzvxj\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340459 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340494 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340558 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340702 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.342659 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.340972 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.343513 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.343334 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.344364 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.344338 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.349413 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.345809 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.349413 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.346310 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.350358 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.350327 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.352527 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.352502 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.353198 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.353174 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.353717 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.353601 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.355418 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.355887 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.356317 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.356516 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.356917 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.357189 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.357358 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.357560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.357404 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.359467 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.359024 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.359729 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.359691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.362535 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.362509 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.362758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.362688 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzvxj\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj\") pod \"prometheus-k8s-0\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.363857 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.363831 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf"} Jun 16 19:50:11.364103 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.364087 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10"} Jun 16 19:50:11.365108 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.365089 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068"} Jun 16 19:50:11.367280 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.367225 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerStarted","Data":"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104"} Jun 16 19:50:11.369682 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.369657 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"a0c0857f3a27a7841e3c446fd86c2ebc2bd205eea2671dba2d657971a040baf8"} Jun 16 19:50:11.369894 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.369877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"337f7631b8cb5d501ac3483fe6463ced36647d66e8fabf1cf584eb66f92b632e"} Jun 16 19:50:11.370067 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.370052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" event={"ID":"59f41e39-61ad-4da7-8d92-bb2a3b75f04f","Type":"ContainerStarted","Data":"a0aa631de68f5fb1ac1ce98b06aaec50f7169ab4a31d6c077f0a0b26001cc091"} Jun 16 19:50:11.370524 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.370502 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:11.437795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.437760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:11.449004 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:11.448904 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.982322367 podStartE2EDuration="6.448878748s" totalImagesPullingTime="3.451437631s" totalInitContainerRuntime="15.11875ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:11.404292105 +0000 UTC m=+63.883352586" watchObservedRunningTime="2026-06-16 19:50:11.448878748 +0000 UTC m=+63.927939231" Jun 16 19:50:12.183232 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.183189 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" podStartSLOduration=3.1301715469999998 podStartE2EDuration="6.183170144s" totalImagesPullingTime="3.052998597s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:06 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:11.452877601 +0000 UTC m=+63.931938118" watchObservedRunningTime="2026-06-16 19:50:12.183170144 +0000 UTC m=+64.662230634" Jun 16 19:50:12.183976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.183959 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:50:12.185669 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:12.185645 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88640eaf_75b1_4b29_81dd_61afad451b50.slice/crio-5824e1f58f9a4adada38bcbd27dd3267055903849f28309efbf043d60bb8b9c7 WatchSource:0}: Error finding container 5824e1f58f9a4adada38bcbd27dd3267055903849f28309efbf043d60bb8b9c7: Status 404 returned error can't find the container with id 5824e1f58f9a4adada38bcbd27dd3267055903849f28309efbf043d60bb8b9c7 Jun 16 19:50:12.376546 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.376512 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1" exitCode=0 Jun 16 19:50:12.376996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.376614 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1"} Jun 16 19:50:12.376996 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.376688 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"5824e1f58f9a4adada38bcbd27dd3267055903849f28309efbf043d60bb8b9c7"} Jun 16 19:50:12.378588 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.378476 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" event={"ID":"0d367536-b292-416b-baf3-5174073df7bc","Type":"ContainerStarted","Data":"8048411c12f2c29023e8a1683d98f34ea26906829800e84448287732e1ccf86f"} Jun 16 19:50:12.378775 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.378704 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:12.381235 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.381210 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" event={"ID":"cc941021-d5f6-4bc8-9b76-633af5319ff9","Type":"ContainerStarted","Data":"d876d40172eef39b30c8dfe9a212508dbb6c937ca6b7c0b59ea78dced536c1ff"} Jun 16 19:50:12.385524 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.385501 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" Jun 16 19:50:12.424141 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.424080 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" podStartSLOduration=2.033765657 podStartE2EDuration="4.424056484s" totalImagesPullingTime="2.390290827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:12.422635444 +0000 UTC m=+64.901695955" watchObservedRunningTime="2026-06-16 19:50:12.424056484 +0000 UTC m=+64.903116962" Jun 16 19:50:12.441185 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:12.441131 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-h7qxb" podStartSLOduration=1.641577738 podStartE2EDuration="3.441113403s" totalImagesPullingTime="1.799535665s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:12.440969377 +0000 UTC m=+64.920029881" watchObservedRunningTime="2026-06-16 19:50:12.441113403 +0000 UTC m=+64.920173884" Jun 16 19:50:13.220918 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.220884 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75ff55c459-s46mv" Jun 16 19:50:13.771722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.771674 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:50:13.775073 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.775040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 16 19:50:13.785201 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.785164 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cd618fa4-e361-4f36-bd6e-9585d5f29ea1-metrics-certs\") pod \"network-metrics-daemon-rzff4\" (UID: \"cd618fa4-e361-4f36-bd6e-9585d5f29ea1\") " pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:50:13.873234 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.873200 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:50:13.873408 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.873294 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:50:13.876448 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.876418 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 16 19:50:13.876589 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.876488 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 16 19:50:13.886831 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.886792 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79c1f5ea-5f3f-496d-82df-ee92bc14dcb9-original-pull-secret\") pod \"global-pull-secret-syncer-6mfpr\" (UID: \"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9\") " pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:50:13.889196 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.889172 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 16 19:50:13.897914 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:13.897885 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pr8bz\" (UniqueName: \"kubernetes.io/projected/218e71c7-6084-4b59-a352-5b7e597a54ee-kube-api-access-pr8bz\") pod \"network-check-target-cw776\" (UID: \"218e71c7-6084-4b59-a352-5b7e597a54ee\") " pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:50:14.005653 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.005612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6mfpr" Jun 16 19:50:14.005975 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.005950 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct5dx\"" Jun 16 19:50:14.012070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.012025 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rzff4" Jun 16 19:50:14.102313 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.102090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-6xrkc\"" Jun 16 19:50:14.109630 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.109572 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:50:14.183454 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.183400 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rzff4"] Jun 16 19:50:14.187652 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:14.187618 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd618fa4_e361_4f36_bd6e_9585d5f29ea1.slice/crio-becb3b77b1b8a84cb2df25c4c079d69e469d3397dfffff50cd4dda13121d0745 WatchSource:0}: Error finding container becb3b77b1b8a84cb2df25c4c079d69e469d3397dfffff50cd4dda13121d0745: Status 404 returned error can't find the container with id becb3b77b1b8a84cb2df25c4c079d69e469d3397dfffff50cd4dda13121d0745 Jun 16 19:50:14.198660 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.197976 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6mfpr"] Jun 16 19:50:14.284514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.284486 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-cw776"] Jun 16 19:50:14.287072 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:50:14.287041 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod218e71c7_6084_4b59_a352_5b7e597a54ee.slice/crio-1cd04841ae24150a248e6ce101f749ff0f647881e9ce5ac181c1556eabda7966 WatchSource:0}: Error finding container 1cd04841ae24150a248e6ce101f749ff0f647881e9ce5ac181c1556eabda7966: Status 404 returned error can't find the container with id 1cd04841ae24150a248e6ce101f749ff0f647881e9ce5ac181c1556eabda7966 Jun 16 19:50:14.390828 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.390784 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cw776" event={"ID":"218e71c7-6084-4b59-a352-5b7e597a54ee","Type":"ContainerStarted","Data":"1cd04841ae24150a248e6ce101f749ff0f647881e9ce5ac181c1556eabda7966"} Jun 16 19:50:14.392490 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.392429 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzff4" event={"ID":"cd618fa4-e361-4f36-bd6e-9585d5f29ea1","Type":"ContainerStarted","Data":"becb3b77b1b8a84cb2df25c4c079d69e469d3397dfffff50cd4dda13121d0745"} Jun 16 19:50:14.394408 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:14.394354 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mfpr" event={"ID":"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9","Type":"ContainerStarted","Data":"db5c26726888c53c1f5c80c9b802c3457ad0dff6169c291e04c12a955dc9e3b2"} Jun 16 19:50:17.388936 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:17.388631 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-8bd545db9-b4zz9" Jun 16 19:50:21.439194 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439143 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81"} Jun 16 19:50:21.439755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f"} Jun 16 19:50:21.439755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea"} Jun 16 19:50:21.439755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439320 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857"} Jun 16 19:50:21.439755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439359 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb"} Jun 16 19:50:21.439755 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.439402 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerStarted","Data":"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0"} Jun 16 19:50:21.441265 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.441235 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6mfpr" event={"ID":"79c1f5ea-5f3f-496d-82df-ee92bc14dcb9","Type":"ContainerStarted","Data":"db02baa5e6944c6b594fc9229e1c1efd3f279c459d58702e464181e7a8fba186"} Jun 16 19:50:21.443012 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.442985 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-cw776" event={"ID":"218e71c7-6084-4b59-a352-5b7e597a54ee","Type":"ContainerStarted","Data":"7877bb456d7a231359173c97d73fc613bb4e2656eae46cba1298d55e136eb8e6"} Jun 16 19:50:21.443129 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.443101 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:50:21.445070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.445039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzff4" event={"ID":"cd618fa4-e361-4f36-bd6e-9585d5f29ea1","Type":"ContainerStarted","Data":"e3dc8044004d9ef66da0d8a36fa8394388ed10a1f2c0040ef48ad1604102e2b7"} Jun 16 19:50:21.445187 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.445083 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rzff4" event={"ID":"cd618fa4-e361-4f36-bd6e-9585d5f29ea1","Type":"ContainerStarted","Data":"287d9944180ad422468661a8222c56726aaab615eecb55a6ac58e7f0469774bf"} Jun 16 19:50:21.473430 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.473356 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.3554703200000002 podStartE2EDuration="10.473330329s" totalImagesPullingTime="8.101033293s" totalInitContainerRuntime="16.826716ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:21.47028544 +0000 UTC m=+73.949345944" watchObservedRunningTime="2026-06-16 19:50:21.473330329 +0000 UTC m=+73.952390810" Jun 16 19:50:21.492323 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.492268 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rzff4" podStartSLOduration=67.225285913 podStartE2EDuration="1m13.492251935s" totalImagesPullingTime="6.266966022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:21.49079104 +0000 UTC m=+73.969851535" watchObservedRunningTime="2026-06-16 19:50:21.492251935 +0000 UTC m=+73.971312422" Jun 16 19:50:21.508694 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.508635 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-cw776" podStartSLOduration=67.318521388 podStartE2EDuration="1m13.50861557s" totalImagesPullingTime="6.190094182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:21.507152706 +0000 UTC m=+73.986213204" watchObservedRunningTime="2026-06-16 19:50:21.50861557 +0000 UTC m=+73.987676049" Jun 16 19:50:21.524904 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:21.524845 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6mfpr" podStartSLOduration=67.231609099 podStartE2EDuration="1m13.524826915s" totalImagesPullingTime="6.293217816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 19:49:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:21.524175745 +0000 UTC m=+74.003236252" watchObservedRunningTime="2026-06-16 19:50:21.524826915 +0000 UTC m=+74.003887392" Jun 16 19:50:26.438919 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:26.438881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:50:29.250654 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:29.250598 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:29.251141 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:29.250714 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:32.496481 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:32.496424 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-9cnsn" event={"ID":"e949bae5-818c-49ff-b473-dd35ef21398d","Type":"ContainerStarted","Data":"a8805110d741cb6e7b4a0d5037d6a263cf00a6f160c11521502ea382670b2299"} Jun 16 19:50:32.496884 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:32.496647 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:32.497959 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:32.497927 2576 patch_prober.go:28] interesting pod/downloads-694c955b9-9cnsn container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" start-of-body= Jun 16 19:50:32.498014 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:32.497981 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-694c955b9-9cnsn" podUID="e949bae5-818c-49ff-b473-dd35ef21398d" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.18:8080/\": dial tcp 10.133.0.18:8080: connect: connection refused" Jun 16 19:50:32.528688 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:32.528640 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-9cnsn" podStartSLOduration=1.402140686 podStartE2EDuration="23.528624949s" totalImagesPullingTime="22.126484263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:50:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:50:32.528093785 +0000 UTC m=+85.007154264" watchObservedRunningTime="2026-06-16 19:50:32.528624949 +0000 UTC m=+85.007685426" Jun 16 19:50:33.506972 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:33.506939 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-9cnsn" Jun 16 19:50:49.255160 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:49.255123 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:49.258898 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:49.258877 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-644967dcb9-b6lww" Jun 16 19:50:52.452393 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:50:52.452363 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-cw776" Jun 16 19:51:11.438758 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:11.438717 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:11.509380 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:11.509351 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:11.696054 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:11.695972 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:25.126595 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.126558 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:25.127620 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.127560 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="alertmanager" containerID="cri-o://dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" gracePeriod=120 Jun 16 19:51:25.128770 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.128196 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="prom-label-proxy" containerID="cri-o://50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" gracePeriod=120 Jun 16 19:51:25.128770 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.128352 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-metric" containerID="cri-o://319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" gracePeriod=120 Jun 16 19:51:25.128770 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.128460 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy" containerID="cri-o://b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" gracePeriod=120 Jun 16 19:51:25.128770 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.128547 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-web" containerID="cri-o://6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" gracePeriod=120 Jun 16 19:51:25.128770 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.128627 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="config-reloader" containerID="cri-o://30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" gracePeriod=120 Jun 16 19:51:25.741333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741303 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" exitCode=0 Jun 16 19:51:25.741333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741326 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" exitCode=0 Jun 16 19:51:25.741333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741334 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" exitCode=0 Jun 16 19:51:25.741333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741342 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" exitCode=0 Jun 16 19:51:25.741600 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741379 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf"} Jun 16 19:51:25.741600 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741466 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068"} Jun 16 19:51:25.741600 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741495 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f"} Jun 16 19:51:25.741600 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:25.741519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07"} Jun 16 19:51:26.385910 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.385884 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.450253 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450225 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450260 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450286 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450304 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450332 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450373 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450398 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450453 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450449 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450480 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450509 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thrzq\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450536 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450569 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.450821 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450600 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config\") pod \"a930c831-89ec-40c5-8b58-074c8e237828\" (UID: \"a930c831-89ec-40c5-8b58-074c8e237828\") " Jun 16 19:51:26.451074 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.450972 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:51:26.451074 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.451025 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:26.451483 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.451384 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:26.454028 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.453972 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.455081 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455051 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.455401 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455365 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out" (OuterVolumeSpecName: "config-out") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:51:26.455556 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455411 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.455632 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455590 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:51:26.455703 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455677 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume" (OuterVolumeSpecName: "config-volume") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.455759 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455725 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq" (OuterVolumeSpecName: "kube-api-access-thrzq") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "kube-api-access-thrzq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:51:26.455887 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.455862 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.459825 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.459797 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.467852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.467782 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config" (OuterVolumeSpecName: "web-config") pod "a930c831-89ec-40c5-8b58-074c8e237828" (UID: "a930c831-89ec-40c5-8b58-074c8e237828"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:26.551205 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551167 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-main-tls\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551205 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551198 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-tls-assets\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551205 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551209 2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-metrics-client-ca\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551218 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551227 2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-alertmanager-main-db\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551238 2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-config-volume\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551246 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thrzq\" (UniqueName: \"kubernetes.io/projected/a930c831-89ec-40c5-8b58-074c8e237828-kube-api-access-thrzq\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551254 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-web-config\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551263 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551271 2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-cluster-tls-config\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551280 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551290 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a930c831-89ec-40c5-8b58-074c8e237828-config-out\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.551474 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.551298 2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a930c831-89ec-40c5-8b58-074c8e237828-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:26.748689 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748591 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" exitCode=0 Jun 16 19:51:26.748689 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748624 2576 generic.go:356] "Generic (PLEG): container finished" podID="a930c831-89ec-40c5-8b58-074c8e237828" containerID="6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" exitCode=0 Jun 16 19:51:26.748689 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748658 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10"} Jun 16 19:51:26.748689 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748681 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 16 19:51:26.748969 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748747 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104"} Jun 16 19:51:26.748969 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a930c831-89ec-40c5-8b58-074c8e237828","Type":"ContainerDied","Data":"e6a375b6e9ca8c6441c518366fe36fb023bbf81a0b5fd2273ca05ee156cd7a21"} Jun 16 19:51:26.748969 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.748811 2576 scope.go:117] "RemoveContainer" containerID="50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" Jun 16 19:51:26.757999 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.757980 2576 scope.go:117] "RemoveContainer" containerID="319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" Jun 16 19:51:26.765401 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.765386 2576 scope.go:117] "RemoveContainer" containerID="b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" Jun 16 19:51:26.771859 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.771839 2576 scope.go:117] "RemoveContainer" containerID="6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" Jun 16 19:51:26.776829 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.776806 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:26.779514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.779496 2576 scope.go:117] "RemoveContainer" containerID="30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" Jun 16 19:51:26.783286 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.783251 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 16 19:51:26.787450 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.787410 2576 scope.go:117] "RemoveContainer" containerID="dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" Jun 16 19:51:26.794539 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.794517 2576 scope.go:117] "RemoveContainer" containerID="49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9" Jun 16 19:51:26.801229 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.801211 2576 scope.go:117] "RemoveContainer" containerID="50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" Jun 16 19:51:26.801519 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.801500 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf\": container with ID starting with 50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf not found: ID does not exist" containerID="50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" Jun 16 19:51:26.801566 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.801529 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf"} err="failed to get container status \"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf\": rpc error: code = NotFound desc = could not find container \"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf\": container with ID starting with 50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf not found: ID does not exist" Jun 16 19:51:26.801566 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.801563 2576 scope.go:117] "RemoveContainer" containerID="319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" Jun 16 19:51:26.801814 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.801787 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10\": container with ID starting with 319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10 not found: ID does not exist" containerID="319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" Jun 16 19:51:26.801897 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.801813 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10"} err="failed to get container status \"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10\": rpc error: code = NotFound desc = could not find container \"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10\": container with ID starting with 319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10 not found: ID does not exist" Jun 16 19:51:26.801897 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.801832 2576 scope.go:117] "RemoveContainer" containerID="b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" Jun 16 19:51:26.802042 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.802025 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068\": container with ID starting with b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068 not found: ID does not exist" containerID="b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" Jun 16 19:51:26.802080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802047 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068"} err="failed to get container status \"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068\": rpc error: code = NotFound desc = could not find container \"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068\": container with ID starting with b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068 not found: ID does not exist" Jun 16 19:51:26.802080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802059 2576 scope.go:117] "RemoveContainer" containerID="6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" Jun 16 19:51:26.802301 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.802285 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104\": container with ID starting with 6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104 not found: ID does not exist" containerID="6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" Jun 16 19:51:26.802350 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802304 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104"} err="failed to get container status \"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104\": rpc error: code = NotFound desc = could not find container \"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104\": container with ID starting with 6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104 not found: ID does not exist" Jun 16 19:51:26.802350 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802317 2576 scope.go:117] "RemoveContainer" containerID="30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" Jun 16 19:51:26.802532 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.802517 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f\": container with ID starting with 30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f not found: ID does not exist" containerID="30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" Jun 16 19:51:26.802580 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802536 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f"} err="failed to get container status \"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f\": rpc error: code = NotFound desc = could not find container \"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f\": container with ID starting with 30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f not found: ID does not exist" Jun 16 19:51:26.802580 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802550 2576 scope.go:117] "RemoveContainer" containerID="dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" Jun 16 19:51:26.802773 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.802758 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07\": container with ID starting with dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07 not found: ID does not exist" containerID="dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" Jun 16 19:51:26.802818 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802775 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07"} err="failed to get container status \"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07\": rpc error: code = NotFound desc = could not find container \"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07\": container with ID starting with dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07 not found: ID does not exist" Jun 16 19:51:26.802818 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802786 2576 scope.go:117] "RemoveContainer" containerID="49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9" Jun 16 19:51:26.802966 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:26.802950 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9\": container with ID starting with 49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9 not found: ID does not exist" containerID="49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9" Jun 16 19:51:26.803002 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802971 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9"} err="failed to get container status \"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9\": rpc error: code = NotFound desc = could not find container \"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9\": container with ID starting with 49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9 not found: ID does not exist" Jun 16 19:51:26.803002 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.802982 2576 scope.go:117] "RemoveContainer" containerID="50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf" Jun 16 19:51:26.803148 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803133 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf"} err="failed to get container status \"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf\": rpc error: code = NotFound desc = could not find container \"50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf\": container with ID starting with 50c1ad0c5c106aeca700db0139e2f18fd3339ea0ed7371aae2f6bb455f9186cf not found: ID does not exist" Jun 16 19:51:26.803187 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803148 2576 scope.go:117] "RemoveContainer" containerID="319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10" Jun 16 19:51:26.803316 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803300 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10"} err="failed to get container status \"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10\": rpc error: code = NotFound desc = could not find container \"319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10\": container with ID starting with 319dc6d7a018141f6bacc528c96046005e766a994f0d8c8d1e72c971ffefed10 not found: ID does not exist" Jun 16 19:51:26.803356 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803317 2576 scope.go:117] "RemoveContainer" containerID="b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068" Jun 16 19:51:26.803547 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803532 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068"} err="failed to get container status \"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068\": rpc error: code = NotFound desc = could not find container \"b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068\": container with ID starting with b2d2dedb2d0bcacfbaafec9769203bb443baa43460a16e97d4e49dae21e3a068 not found: ID does not exist" Jun 16 19:51:26.803594 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803548 2576 scope.go:117] "RemoveContainer" containerID="6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104" Jun 16 19:51:26.803764 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803746 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104"} err="failed to get container status \"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104\": rpc error: code = NotFound desc = could not find container \"6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104\": container with ID starting with 6acc290a152aeeb445832b11c2ca3af28bf7636739d62b3cdb9060bd912d2104 not found: ID does not exist" Jun 16 19:51:26.803805 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803765 2576 scope.go:117] "RemoveContainer" containerID="30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f" Jun 16 19:51:26.803971 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803954 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f"} err="failed to get container status \"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f\": rpc error: code = NotFound desc = could not find container \"30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f\": container with ID starting with 30cd03d266fd8e7079fe793d3fb9605397e858b2850467bf7c870ca71d2f702f not found: ID does not exist" Jun 16 19:51:26.804010 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.803971 2576 scope.go:117] "RemoveContainer" containerID="dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07" Jun 16 19:51:26.804154 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.804138 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07"} err="failed to get container status \"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07\": rpc error: code = NotFound desc = could not find container \"dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07\": container with ID starting with dd1897cdca8a414060e0748a6126b26f9d2e2cbd44b8517b26d88bb2c7fe2e07 not found: ID does not exist" Jun 16 19:51:26.804195 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.804155 2576 scope.go:117] "RemoveContainer" containerID="49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9" Jun 16 19:51:26.804376 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:26.804355 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9"} err="failed to get container status \"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9\": rpc error: code = NotFound desc = could not find container \"49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9\": container with ID starting with 49d6735c5a2e164d498ff45dd597ea2d3c63436928e2c84b50ffff46534f8af9 not found: ID does not exist" Jun 16 19:51:27.994261 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:27.994225 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a930c831-89ec-40c5-8b58-074c8e237828" path="/var/lib/kubelet/pods/a930c831-89ec-40c5-8b58-074c8e237828/volumes" Jun 16 19:51:29.495107 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495070 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:29.495725 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495681 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="prometheus" containerID="cri-o://f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0" gracePeriod=600 Jun 16 19:51:29.495725 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495722 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-web" containerID="cri-o://3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea" gracePeriod=600 Jun 16 19:51:29.495921 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495701 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="thanos-sidecar" containerID="cri-o://fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857" gracePeriod=600 Jun 16 19:51:29.495975 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495940 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="config-reloader" containerID="cri-o://397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb" gracePeriod=600 Jun 16 19:51:29.495975 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.495945 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81" gracePeriod=600 Jun 16 19:51:29.496100 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.496072 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy" containerID="cri-o://2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f" gracePeriod=600 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767713 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81" exitCode=0 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767739 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f" exitCode=0 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767745 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857" exitCode=0 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767751 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb" exitCode=0 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767755 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0" exitCode=0 Jun 16 19:51:29.767795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81"} Jun 16 19:51:29.768070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f"} Jun 16 19:51:29.768070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767870 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857"} Jun 16 19:51:29.768070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767898 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb"} Jun 16 19:51:29.768070 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:29.767920 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0"} Jun 16 19:51:30.745050 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.745027 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:30.774899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.774866 2576 generic.go:356] "Generic (PLEG): container finished" podID="88640eaf-75b1-4b29-81dd-61afad451b50" containerID="3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea" exitCode=0 Jun 16 19:51:30.775056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.774933 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:30.775056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.774948 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea"} Jun 16 19:51:30.775056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.775011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"88640eaf-75b1-4b29-81dd-61afad451b50","Type":"ContainerDied","Data":"5824e1f58f9a4adada38bcbd27dd3267055903849f28309efbf043d60bb8b9c7"} Jun 16 19:51:30.775056 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.775043 2576 scope.go:117] "RemoveContainer" containerID="d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81" Jun 16 19:51:30.782985 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.782964 2576 scope.go:117] "RemoveContainer" containerID="2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f" Jun 16 19:51:30.785351 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785323 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785480 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785374 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785560 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785547 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785618 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785592 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785623 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785651 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785764 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785690 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785764 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785716 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzvxj\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785764 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785739 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785784 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785810 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.785917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.785860 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.786551 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.786189 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.787677 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.787398 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.787677 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.787407 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:51:30.787834 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.787761 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.788294 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.788188 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.789332 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.789278 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.790408 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790338 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.790408 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790389 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj" (OuterVolumeSpecName: "kube-api-access-fzvxj") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "kube-api-access-fzvxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790491 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790532 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790538 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790615 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790663 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790749 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790796 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.791115 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.790825 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy\") pod \"88640eaf-75b1-4b29-81dd-61afad451b50\" (UID: \"88640eaf-75b1-4b29-81dd-61afad451b50\") " Jun 16 19:51:30.792725 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.791699 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.792725 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.792501 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.795544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.793694 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.795544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.795255 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 16 19:51:30.795544 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.795285 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out" (OuterVolumeSpecName: "config-out") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 16 19:51:30.796292 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796130 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796292 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796157 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-trusted-ca-bundle\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796292 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796172 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796292 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796194 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796207 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-tls\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796324 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796343 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-db\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796356 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzvxj\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-kube-api-access-fzvxj\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796370 2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/88640eaf-75b1-4b29-81dd-61afad451b50-config-out\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796455 2576 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796474 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-metrics-client-ca\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796487 2576 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.796550 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.796501 2576 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/88640eaf-75b1-4b29-81dd-61afad451b50-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.801644 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.801612 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config" (OuterVolumeSpecName: "config") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.802082 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.802053 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.802226 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.802199 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.802401 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.802375 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.802546 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.802526 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 19:51:30.802710 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.802284 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.811848 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.811819 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config" (OuterVolumeSpecName: "web-config") pod "88640eaf-75b1-4b29-81dd-61afad451b50" (UID: "88640eaf-75b1-4b29-81dd-61afad451b50"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 19:51:30.816701 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.816680 2576 scope.go:117] "RemoveContainer" containerID="3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea" Jun 16 19:51:30.824280 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.824255 2576 scope.go:117] "RemoveContainer" containerID="fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857" Jun 16 19:51:30.831212 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.831193 2576 scope.go:117] "RemoveContainer" containerID="397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb" Jun 16 19:51:30.837903 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.837887 2576 scope.go:117] "RemoveContainer" containerID="f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0" Jun 16 19:51:30.845503 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.845485 2576 scope.go:117] "RemoveContainer" containerID="dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1" Jun 16 19:51:30.853710 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.853690 2576 scope.go:117] "RemoveContainer" containerID="d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81" Jun 16 19:51:30.854011 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.853986 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81\": container with ID starting with d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81 not found: ID does not exist" containerID="d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81" Jun 16 19:51:30.854068 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854020 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81"} err="failed to get container status \"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81\": rpc error: code = NotFound desc = could not find container \"d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81\": container with ID starting with d86e89978c22d0a8b17c2497df23d0481679921fc8e39292a591aec6155bdc81 not found: ID does not exist" Jun 16 19:51:30.854068 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854039 2576 scope.go:117] "RemoveContainer" containerID="2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f" Jun 16 19:51:30.854296 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.854279 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f\": container with ID starting with 2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f not found: ID does not exist" containerID="2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f" Jun 16 19:51:30.854332 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854303 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f"} err="failed to get container status \"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f\": rpc error: code = NotFound desc = could not find container \"2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f\": container with ID starting with 2cb47431dcf237767a7e3601cda85a2fd61e026a68fd6f2b28c97c023222495f not found: ID does not exist" Jun 16 19:51:30.854332 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854322 2576 scope.go:117] "RemoveContainer" containerID="3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea" Jun 16 19:51:30.854583 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.854567 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea\": container with ID starting with 3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea not found: ID does not exist" containerID="3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea" Jun 16 19:51:30.854652 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854585 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea"} err="failed to get container status \"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea\": rpc error: code = NotFound desc = could not find container \"3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea\": container with ID starting with 3cc9f2388acb8953d325f233cd50da82b526e129f673c494cd64a5f46d45f7ea not found: ID does not exist" Jun 16 19:51:30.854652 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854599 2576 scope.go:117] "RemoveContainer" containerID="fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857" Jun 16 19:51:30.854817 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.854800 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857\": container with ID starting with fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857 not found: ID does not exist" containerID="fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857" Jun 16 19:51:30.854866 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854824 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857"} err="failed to get container status \"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857\": rpc error: code = NotFound desc = could not find container \"fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857\": container with ID starting with fc81c09f8dfcdd9076950e8180036d9904abdd324032f36a7db57c7e397b3857 not found: ID does not exist" Jun 16 19:51:30.854866 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.854839 2576 scope.go:117] "RemoveContainer" containerID="397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb" Jun 16 19:51:30.855053 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.855038 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb\": container with ID starting with 397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb not found: ID does not exist" containerID="397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb" Jun 16 19:51:30.855096 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.855056 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb"} err="failed to get container status \"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb\": rpc error: code = NotFound desc = could not find container \"397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb\": container with ID starting with 397ba4c04fd1c9845ab52cd9ac3354df13b619e13957a0ef7e0d23d0632d19eb not found: ID does not exist" Jun 16 19:51:30.855096 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.855068 2576 scope.go:117] "RemoveContainer" containerID="f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0" Jun 16 19:51:30.855271 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.855253 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0\": container with ID starting with f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0 not found: ID does not exist" containerID="f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0" Jun 16 19:51:30.855305 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.855274 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0"} err="failed to get container status \"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0\": rpc error: code = NotFound desc = could not find container \"f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0\": container with ID starting with f90c48729e1fdf011ab9ca3567077204b4a46db7bff843f67fe41665a2112fb0 not found: ID does not exist" Jun 16 19:51:30.855305 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.855286 2576 scope.go:117] "RemoveContainer" containerID="dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1" Jun 16 19:51:30.855518 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:51:30.855502 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1\": container with ID starting with dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1 not found: ID does not exist" containerID="dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1" Jun 16 19:51:30.855564 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.855520 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1"} err="failed to get container status \"dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1\": rpc error: code = NotFound desc = could not find container \"dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1\": container with ID starting with dbc049dde9a4b555254f6d913f9e4244878d5acf615143c782b177665a3127a1 not found: ID does not exist" Jun 16 19:51:30.897264 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897230 2576 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-thanos-prometheus-http-client-file\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897264 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897258 2576 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-grpc-tls\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897264 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897272 2576 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-kube-rbac-proxy\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897488 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897282 2576 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-config\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897488 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897291 2576 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-secret-metrics-client-certs\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897488 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897300 2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/88640eaf-75b1-4b29-81dd-61afad451b50-web-config\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:30.897488 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:30.897307 2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/88640eaf-75b1-4b29-81dd-61afad451b50-tls-assets\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 19:51:31.104840 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.104766 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:31.115253 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.115220 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:31.144627 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144596 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:31.144877 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144865 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144878 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144886 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="prometheus" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144892 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="prometheus" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144902 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="alertmanager" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144908 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="alertmanager" Jun 16 19:51:31.144917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144914 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="init-config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144919 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="init-config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144927 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144932 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144939 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144944 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144952 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="prom-label-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144956 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="prom-label-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144963 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144969 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144977 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="init-config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144982 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="init-config-reloader" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144989 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144993 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.144999 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-thanos" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145003 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-thanos" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145008 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-metric" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145013 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-metric" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145019 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="thanos-sidecar" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145024 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="thanos-sidecar" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145030 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145035 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145075 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="thanos-sidecar" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145083 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.145080 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145090 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy-metric" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145096 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="prometheus" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145101 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="kube-rbac-proxy" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145106 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="config-reloader" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145111 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-thanos" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145116 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="config-reloader" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145120 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy-web" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145126 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="alertmanager" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145132 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" containerName="kube-rbac-proxy" Jun 16 19:51:31.145730 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.145137 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="a930c831-89ec-40c5-8b58-074c8e237828" containerName="prom-label-proxy" Jun 16 19:51:31.148714 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.148693 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.151336 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.151317 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 16 19:51:31.151683 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.151663 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 16 19:51:31.151765 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.151736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 16 19:51:31.152039 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152024 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-atbf4ims3gjjj\"" Jun 16 19:51:31.152263 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152249 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 16 19:51:31.152710 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152684 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 16 19:51:31.152710 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152691 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 16 19:51:31.152852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152704 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 16 19:51:31.152852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152730 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 16 19:51:31.152852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152787 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 16 19:51:31.152852 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152814 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 16 19:51:31.153047 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.152908 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 16 19:51:31.153353 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.153336 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 16 19:51:31.153684 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.153669 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2p8fm\"" Jun 16 19:51:31.157046 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.157030 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 16 19:51:31.159964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.159942 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 16 19:51:31.170786 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.170761 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:31.200271 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjqrb\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-kube-api-access-bjqrb\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200274 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200319 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200354 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200377 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200415 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200398 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200602 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200634 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200631 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200670 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200689 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200704 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200754 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.200802 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.200770 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301255 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301218 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301255 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301277 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301297 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301371 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301402 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301463 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301486 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301521 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301513 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301540 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301564 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjqrb\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-kube-api-access-bjqrb\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301611 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301640 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301678 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301758 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301764 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301827 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.301915 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.301864 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.302487 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.302071 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.302559 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.302541 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.303411 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.303382 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304124 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.303806 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8e640d98-4b91-4d7b-9387-74e8a0504450-config-out\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304124 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304059 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304320 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304224 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304320 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304254 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304715 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304692 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304801 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304694 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.304858 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.304810 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.305351 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.305280 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.305746 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.305726 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.306053 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.306033 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.306137 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.306118 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-web-config\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.306656 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.306630 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.307132 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.307114 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.307198 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.307155 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/8e640d98-4b91-4d7b-9387-74e8a0504450-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.307541 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.307523 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/8e640d98-4b91-4d7b-9387-74e8a0504450-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.313566 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.313546 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjqrb\" (UniqueName: \"kubernetes.io/projected/8e640d98-4b91-4d7b-9387-74e8a0504450-kube-api-access-bjqrb\") pod \"prometheus-k8s-0\" (UID: \"8e640d98-4b91-4d7b-9387-74e8a0504450\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.459081 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.459043 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:51:31.605965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.605937 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 16 19:51:31.608543 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:51:31.608515 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e640d98_4b91_4d7b_9387_74e8a0504450.slice/crio-a9690d898a08fa8fc4fb7f3f2b6a632727ec7fdb6193861edaf08d10b1c2effb WatchSource:0}: Error finding container a9690d898a08fa8fc4fb7f3f2b6a632727ec7fdb6193861edaf08d10b1c2effb: Status 404 returned error can't find the container with id a9690d898a08fa8fc4fb7f3f2b6a632727ec7fdb6193861edaf08d10b1c2effb Jun 16 19:51:31.781040 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.780950 2576 generic.go:356] "Generic (PLEG): container finished" podID="8e640d98-4b91-4d7b-9387-74e8a0504450" containerID="a0048e083c217c33e88ea46e3b105d10b60410fa78ce8b5653033e1734a92d60" exitCode=0 Jun 16 19:51:31.781040 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.781005 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerDied","Data":"a0048e083c217c33e88ea46e3b105d10b60410fa78ce8b5653033e1734a92d60"} Jun 16 19:51:31.781562 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.781070 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"a9690d898a08fa8fc4fb7f3f2b6a632727ec7fdb6193861edaf08d10b1c2effb"} Jun 16 19:51:31.998499 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:31.997819 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88640eaf-75b1-4b29-81dd-61afad451b50" path="/var/lib/kubelet/pods/88640eaf-75b1-4b29-81dd-61afad451b50/volumes" Jun 16 19:51:32.788235 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"dc53fbffb75d6ea9a04fdc7ddb9d32f70f4603c91a51d06999ce08d4ab7897b4"} Jun 16 19:51:32.788692 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788291 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"cff9d485eb3bfd8d78757fb20c9424e50ec0bcfdde29846d78230499d2759d03"} Jun 16 19:51:32.788692 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788318 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"c76008502e73b521d6fb913609ee54f99f228634c6f14eb617799183e149849b"} Jun 16 19:51:32.788692 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788349 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"c4a146b4fce94839dddc4f549292e6a11a50a40d994ee7c387516cc8d0fb710b"} Jun 16 19:51:32.788692 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"c35c5c016cfe9ef3470030a2958832e9a6fb16a15b037de6a32df337c82bb0ac"} Jun 16 19:51:32.788692 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.788396 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"8e640d98-4b91-4d7b-9387-74e8a0504450","Type":"ContainerStarted","Data":"be434588375aa47918855f1632c50405430c99f276804cccbce10b2af05da25d"} Jun 16 19:51:32.823359 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:32.823297 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.804680445 podStartE2EDuration="1.823275918s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.595473ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:51:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:51:32.820740516 +0000 UTC m=+145.299801022" watchObservedRunningTime="2026-06-16 19:51:32.823275918 +0000 UTC m=+145.302336398" Jun 16 19:51:36.459512 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:51:36.459476 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:52:31.460036 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:52:31.459981 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:52:31.475520 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:52:31.475497 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:52:32.030543 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:52:32.030518 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 16 19:54:07.943140 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:07.943109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:54:07.943697 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:07.943604 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:54:07.946303 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:07.946268 2576 kubelet.go:1648] "Image garbage collection succeeded" Jun 16 19:54:18.035779 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.035741 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks"] Jun 16 19:54:18.037784 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.037760 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.041389 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041353 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 16 19:54:18.041389 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041370 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 16 19:54:18.041577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041390 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-ktjb5\"" Jun 16 19:54:18.041577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041463 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 16 19:54:18.041577 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041512 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 16 19:54:18.041714 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.041594 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 16 19:54:18.050931 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.050911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks"] Jun 16 19:54:18.107545 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.107502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20e6914e-bc79-4117-9a56-4e11e3228866-manager-config\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.107728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.107572 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-metrics-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.107728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.107632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.107728 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.107650 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fbpb\" (UniqueName: \"kubernetes.io/projected/20e6914e-bc79-4117-9a56-4e11e3228866-kube-api-access-9fbpb\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.208966 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.208933 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.208966 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.208966 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fbpb\" (UniqueName: \"kubernetes.io/projected/20e6914e-bc79-4117-9a56-4e11e3228866-kube-api-access-9fbpb\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.209165 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.208992 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20e6914e-bc79-4117-9a56-4e11e3228866-manager-config\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.209165 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.209050 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-metrics-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.209686 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.209661 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/20e6914e-bc79-4117-9a56-4e11e3228866-manager-config\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.211389 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.211361 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.211517 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.211403 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/20e6914e-bc79-4117-9a56-4e11e3228866-metrics-cert\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.220088 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.220067 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fbpb\" (UniqueName: \"kubernetes.io/projected/20e6914e-bc79-4117-9a56-4e11e3228866-kube-api-access-9fbpb\") pod \"lws-controller-manager-7ff6468978-7mxks\" (UID: \"20e6914e-bc79-4117-9a56-4e11e3228866\") " pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.346507 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.346411 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:18.479564 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.479463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks"] Jun 16 19:54:18.482069 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:54:18.482039 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e6914e_bc79_4117_9a56_4e11e3228866.slice/crio-10409156f307427d25e330a86773ae1ca1486cadceebecb58eac74f1383d834e WatchSource:0}: Error finding container 10409156f307427d25e330a86773ae1ca1486cadceebecb58eac74f1383d834e: Status 404 returned error can't find the container with id 10409156f307427d25e330a86773ae1ca1486cadceebecb58eac74f1383d834e Jun 16 19:54:18.483939 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:18.483924 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 19:54:19.426168 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:19.426135 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" event={"ID":"20e6914e-bc79-4117-9a56-4e11e3228866","Type":"ContainerStarted","Data":"10409156f307427d25e330a86773ae1ca1486cadceebecb58eac74f1383d834e"} Jun 16 19:54:21.435220 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:21.435188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" event={"ID":"20e6914e-bc79-4117-9a56-4e11e3228866","Type":"ContainerStarted","Data":"12d8160284e7f0bfdd377e9bc57f5dddf0e493cca11a3f995df0b107ff320606"} Jun 16 19:54:21.435616 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:21.435268 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:21.454964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:21.454914 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" podStartSLOduration=0.819727406 podStartE2EDuration="3.4548967s" totalImagesPullingTime="2.635169294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:21.454241024 +0000 UTC m=+313.933301535" watchObservedRunningTime="2026-06-16 19:54:21.4548967 +0000 UTC m=+313.933957178" Jun 16 19:54:29.048285 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.048251 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv"] Jun 16 19:54:29.050754 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.050725 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.053578 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.053552 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 16 19:54:29.053757 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.053736 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-r9w4c\"" Jun 16 19:54:29.053850 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.053833 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 16 19:54:29.053927 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.053866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 16 19:54:29.054163 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.054148 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 16 19:54:29.069405 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.069357 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv"] Jun 16 19:54:29.107542 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.107504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.107722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.107548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.107722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.107629 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklfn\" (UniqueName: \"kubernetes.io/projected/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-kube-api-access-dklfn\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.107722 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.107703 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.107848 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.107751 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208450 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208606 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208606 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208514 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklfn\" (UniqueName: \"kubernetes.io/projected/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-kube-api-access-dklfn\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208606 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208571 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208761 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208606 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.208964 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.208941 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-manifests\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.210853 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.210823 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-tmp\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.210999 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.210984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.211037 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.211017 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-webhook-cert\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.220286 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.220263 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklfn\" (UniqueName: \"kubernetes.io/projected/8dd29b7d-4ca7-4275-8653-16a54cf60f3f-kube-api-access-dklfn\") pod \"opendatahub-operator-controller-manager-5cbd84db66-4dphv\" (UID: \"8dd29b7d-4ca7-4275-8653-16a54cf60f3f\") " pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.361913 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.361830 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:29.519976 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:29.519944 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv"] Jun 16 19:54:29.523092 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:54:29.523067 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd29b7d_4ca7_4275_8653_16a54cf60f3f.slice/crio-0b1bfd905728e64abca55b9232e6833d5ffbc13e6fcac625c64669b18b90e82c WatchSource:0}: Error finding container 0b1bfd905728e64abca55b9232e6833d5ffbc13e6fcac625c64669b18b90e82c: Status 404 returned error can't find the container with id 0b1bfd905728e64abca55b9232e6833d5ffbc13e6fcac625c64669b18b90e82c Jun 16 19:54:30.474959 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:30.474917 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" event={"ID":"8dd29b7d-4ca7-4275-8653-16a54cf60f3f","Type":"ContainerStarted","Data":"0b1bfd905728e64abca55b9232e6833d5ffbc13e6fcac625c64669b18b90e82c"} Jun 16 19:54:32.442012 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:32.441980 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7ff6468978-7mxks" Jun 16 19:54:33.492508 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:33.492467 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" event={"ID":"8dd29b7d-4ca7-4275-8653-16a54cf60f3f","Type":"ContainerStarted","Data":"20d61b33fc82846d41ce5bbfd0ddefb4c8c6f7979531e9c4fa4af71d7647621f"} Jun 16 19:54:34.498084 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:34.498047 2576 generic.go:356] "Generic (PLEG): container finished" podID="8dd29b7d-4ca7-4275-8653-16a54cf60f3f" containerID="20d61b33fc82846d41ce5bbfd0ddefb4c8c6f7979531e9c4fa4af71d7647621f" exitCode=0 Jun 16 19:54:34.498494 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:34.498097 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" event={"ID":"8dd29b7d-4ca7-4275-8653-16a54cf60f3f","Type":"ContainerDied","Data":"20d61b33fc82846d41ce5bbfd0ddefb4c8c6f7979531e9c4fa4af71d7647621f"} Jun 16 19:54:35.504346 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:35.504309 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" event={"ID":"8dd29b7d-4ca7-4275-8653-16a54cf60f3f","Type":"ContainerStarted","Data":"e65517cec39138a1da26a1509f2455ffa33ae305accb2e14070b0bf838471e1b"} Jun 16 19:54:35.504721 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:35.504472 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:35.533328 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:35.533280 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" podStartSLOduration=1.9451211929999999 podStartE2EDuration="6.533264471s" totalImagesPullingTime="3.652721097s" totalInitContainerRuntime="935.422181ms" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:54:35.5311758 +0000 UTC m=+328.010236301" watchObservedRunningTime="2026-06-16 19:54:35.533264471 +0000 UTC m=+328.012324949" Jun 16 19:54:46.510457 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:46.510408 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5cbd84db66-4dphv" Jun 16 19:54:59.604908 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.604877 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-6tskx"] Jun 16 19:54:59.607354 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.607334 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.611828 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.611801 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 16 19:54:59.612209 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.612193 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 16 19:54:59.612277 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.612211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 16 19:54:59.612277 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.612211 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-47v7d\"" Jun 16 19:54:59.613745 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.613722 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 16 19:54:59.627015 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.626992 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-6tskx"] Jun 16 19:54:59.676365 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.676329 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tmp\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.676576 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.676395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.676576 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.676428 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k46z\" (UniqueName: \"kubernetes.io/projected/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-kube-api-access-4k46z\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.777684 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.777654 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tmp\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.777845 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.777731 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.777845 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.777757 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k46z\" (UniqueName: \"kubernetes.io/projected/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-kube-api-access-4k46z\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.777964 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:54:59.777890 2576 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 16 19:54:59.778011 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:54:59.777966 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs podName:2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf nodeName:}" failed. No retries permitted until 2026-06-16 19:55:00.277945573 +0000 UTC m=+352.757006033 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs") pod "kube-auth-proxy-58ff4d787-6tskx" (UID: "2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf") : secret "kube-auth-proxy-tls" not found Jun 16 19:54:59.779929 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.779901 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tmp\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:54:59.793484 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:54:59.793460 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k46z\" (UniqueName: \"kubernetes.io/projected/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-kube-api-access-4k46z\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:55:00.282709 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:00.282673 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:55:00.285083 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:00.285060 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf-tls-certs\") pod \"kube-auth-proxy-58ff4d787-6tskx\" (UID: \"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf\") " pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:55:00.516899 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:00.516873 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" Jun 16 19:55:00.650817 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:00.650776 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-58ff4d787-6tskx"] Jun 16 19:55:01.618945 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:01.618885 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" event={"ID":"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf","Type":"ContainerStarted","Data":"6021a3930eb57376585320ef98dd0d22f3675de9baefa9f3987fc270f5689b0e"} Jun 16 19:55:04.635636 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:04.635600 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" event={"ID":"2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf","Type":"ContainerStarted","Data":"f5ca548e97abaa35ab4939d7e73980dbe1c422c691f086884ce1ad1bba08eade"} Jun 16 19:55:04.656303 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:55:04.656250 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-58ff4d787-6tskx" podStartSLOduration=2.445660225 podStartE2EDuration="5.656234229s" totalImagesPullingTime="3.210574004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:54:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:55:04.65605544 +0000 UTC m=+357.135115918" watchObservedRunningTime="2026-06-16 19:55:04.656234229 +0000 UTC m=+357.135294706" Jun 16 19:56:37.173514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.173417 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p"] Jun 16 19:56:37.176747 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.176730 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.179300 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.179274 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 16 19:56:37.179476 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.179457 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 16 19:56:37.179540 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.179523 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 16 19:56:37.180419 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.180406 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 16 19:56:37.180490 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.180407 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pgnj\"" Jun 16 19:56:37.184612 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.184591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p"] Jun 16 19:56:37.233311 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.233275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nszkv\" (UniqueName: \"kubernetes.io/projected/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-kube-api-access-nszkv\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.233504 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.233330 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.233504 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.233380 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.334190 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.334154 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nszkv\" (UniqueName: \"kubernetes.io/projected/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-kube-api-access-nszkv\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.334357 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.334215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.334357 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.334252 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.334484 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:56:37.334351 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 16 19:56:37.334484 ip-10-0-139-232 kubenswrapper[2576]: E0616 19:56:37.334422 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert podName:08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6 nodeName:}" failed. No retries permitted until 2026-06-16 19:56:37.834405902 +0000 UTC m=+450.313466357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-28n8p" (UID: "08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6") : secret "plugin-serving-cert" not found Jun 16 19:56:37.334879 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.334862 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.343621 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.343592 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nszkv\" (UniqueName: \"kubernetes.io/projected/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-kube-api-access-nszkv\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.838708 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.838666 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:37.841007 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:37.840984 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-28n8p\" (UID: \"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:38.093462 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:38.093365 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" Jun 16 19:56:38.226104 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:38.226068 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p"] Jun 16 19:56:38.229545 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:56:38.229518 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod08dbd61a_8c4d_4eff_ba81_974ffdb7a6e6.slice/crio-60a833c4f473fb4f9f541915d16cc2c6711c18611f3c174dec3b6f3ecb08c115 WatchSource:0}: Error finding container 60a833c4f473fb4f9f541915d16cc2c6711c18611f3c174dec3b6f3ecb08c115: Status 404 returned error can't find the container with id 60a833c4f473fb4f9f541915d16cc2c6711c18611f3c174dec3b6f3ecb08c115 Jun 16 19:56:39.041869 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:56:39.041836 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" event={"ID":"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6","Type":"ContainerStarted","Data":"60a833c4f473fb4f9f541915d16cc2c6711c18611f3c174dec3b6f3ecb08c115"} Jun 16 19:57:03.161759 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:03.161721 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" event={"ID":"08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6","Type":"ContainerStarted","Data":"2bdc733c86744470d2f0fb49678b8e7697d96bda1c7dc610ce95978df0ad9867"} Jun 16 19:57:03.183333 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:03.183282 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-28n8p" podStartSLOduration=2.131413251 podStartE2EDuration="26.183268338s" totalImagesPullingTime="24.051855087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:56:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:03.182387897 +0000 UTC m=+475.661448391" watchObservedRunningTime="2026-06-16 19:57:03.183268338 +0000 UTC m=+475.662328815" Jun 16 19:57:32.686719 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.686679 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 19:57:32.730330 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.730294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 19:57:32.730330 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.730333 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 19:57:32.730543 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.730415 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.732724 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.732701 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 16 19:57:32.822226 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.822188 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-config-file\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.822226 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.822237 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b28gb\" (UniqueName: \"kubernetes.io/projected/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-kube-api-access-b28gb\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.923023 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.922991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b28gb\" (UniqueName: \"kubernetes.io/projected/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-kube-api-access-b28gb\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.923197 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.923085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-config-file\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.923720 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.923702 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-config-file\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:32.932921 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:32.932888 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b28gb\" (UniqueName: \"kubernetes.io/projected/80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47-kube-api-access-b28gb\") pod \"limitador-limitador-54d6d988d5-9pxbd\" (UID: \"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:33.040623 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:33.040543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:33.171000 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:33.170930 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 19:57:33.173829 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:57:33.173799 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80bdaa32_7f88_4a5a_a8fc_480bc8ff5d47.slice/crio-d26b699399f30dca7cbd3855a296f294e347c6df056f06801df07c6743b1e082 WatchSource:0}: Error finding container d26b699399f30dca7cbd3855a296f294e347c6df056f06801df07c6743b1e082: Status 404 returned error can't find the container with id d26b699399f30dca7cbd3855a296f294e347c6df056f06801df07c6743b1e082 Jun 16 19:57:33.286797 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:33.286761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" event={"ID":"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47","Type":"ContainerStarted","Data":"d26b699399f30dca7cbd3855a296f294e347c6df056f06801df07c6743b1e082"} Jun 16 19:57:36.302675 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:36.302587 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" event={"ID":"80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47","Type":"ContainerStarted","Data":"a8e19aed103490b4011e9bd6b98dde8458c19f0574c1c5785e531114174c4b85"} Jun 16 19:57:36.303058 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:36.302701 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:57:36.326538 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:36.326485 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" podStartSLOduration=1.574833296 podStartE2EDuration="4.326469852s" totalImagesPullingTime="2.751636556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:57:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:57:36.32454441 +0000 UTC m=+508.803604888" watchObservedRunningTime="2026-06-16 19:57:36.326469852 +0000 UTC m=+508.805530329" Jun 16 19:57:47.308225 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:57:47.308183 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-9pxbd" Jun 16 19:58:41.495217 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.495179 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 19:58:41.497545 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.497525 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:41.501117 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.501090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 16 19:58:41.501383 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.501365 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 16 19:58:41.502122 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.502090 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7wgbj\"" Jun 16 19:58:41.502430 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.502413 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 16 19:58:41.510551 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.510346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 19:58:41.632669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.632632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrpjj\" (UniqueName: \"kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj\") pod \"maas-keycloak-0\" (UID: \"f3c31abb-bd6e-49cb-a95f-d1903b848e34\") " pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:41.733252 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.733215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrpjj\" (UniqueName: \"kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj\") pod \"maas-keycloak-0\" (UID: \"f3c31abb-bd6e-49cb-a95f-d1903b848e34\") " pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:41.748881 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.748813 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrpjj\" (UniqueName: \"kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj\") pod \"maas-keycloak-0\" (UID: \"f3c31abb-bd6e-49cb-a95f-d1903b848e34\") " pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:41.813762 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.813709 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:41.947669 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:41.947638 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 19:58:41.950571 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:58:41.950542 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c31abb_bd6e_49cb_a95f_d1903b848e34.slice/crio-09ac7eac328a86650796501d2c1df34352969339e64523e455dd52ac03dc2d61 WatchSource:0}: Error finding container 09ac7eac328a86650796501d2c1df34352969339e64523e455dd52ac03dc2d61: Status 404 returned error can't find the container with id 09ac7eac328a86650796501d2c1df34352969339e64523e455dd52ac03dc2d61 Jun 16 19:58:42.590178 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:42.590138 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3c31abb-bd6e-49cb-a95f-d1903b848e34","Type":"ContainerStarted","Data":"09ac7eac328a86650796501d2c1df34352969339e64523e455dd52ac03dc2d61"} Jun 16 19:58:46.616334 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:46.616297 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3c31abb-bd6e-49cb-a95f-d1903b848e34","Type":"ContainerStarted","Data":"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7"} Jun 16 19:58:46.643508 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:46.643451 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.05624957 podStartE2EDuration="5.643418815s" totalImagesPullingTime="4.587169245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:58:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:58:46.641911924 +0000 UTC m=+579.120972429" watchObservedRunningTime="2026-06-16 19:58:46.643418815 +0000 UTC m=+579.122479294" Jun 16 19:58:46.814558 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:46.814281 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:46.816354 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:46.816315 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:47.814670 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:47.814616 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:48.814737 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:48.814670 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:49.814819 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:49.814759 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:50.814660 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:50.814607 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:51.815068 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:51.814344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:51.815573 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:51.815357 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:52.814965 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:52.814909 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:53.815132 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:53.815076 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:54.814885 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:54.814837 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:55.814514 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:55.814460 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:56.814798 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:56.814745 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:57.814910 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:57.814856 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:58.814483 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:58.814422 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.26:9000/health/started\": dial tcp 10.133.0.26:9000: connect: connection refused" Jun 16 19:58:59.932576 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:59.932537 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 16 19:58:59.951187 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:58:59.951134 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 16 19:59:07.975683 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:07.975650 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:59:07.976206 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:07.975957 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 19:59:09.939586 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:09.939542 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 16 19:59:16.753775 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.753736 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 19:59:16.760824 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.760804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.763735 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.763715 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 16 19:59:16.764702 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.764679 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 16 19:59:16.764702 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.764695 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5b658\"" Jun 16 19:59:16.766917 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.766896 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 19:59:16.877565 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.877527 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmq9k\" (UniqueName: \"kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.877751 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.877604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.978428 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.978386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.978640 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.978505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmq9k\" (UniqueName: \"kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.980795 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.980771 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:16.988400 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:16.988366 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmq9k\" (UniqueName: \"kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k\") pod \"maas-controller-74dc455d58-5t87n\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:17.072910 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:17.072816 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:17.220270 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:17.220224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 19:59:17.220378 ip-10-0-139-232 kubenswrapper[2576]: W0616 19:59:17.220334 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddceff386_f5ed_4c86_89e8_506743bc322e.slice/crio-71986a1fef615630991034422ba3a8d4f803da32a9a42d2fbb5c074375b1a54e WatchSource:0}: Error finding container 71986a1fef615630991034422ba3a8d4f803da32a9a42d2fbb5c074375b1a54e: Status 404 returned error can't find the container with id 71986a1fef615630991034422ba3a8d4f803da32a9a42d2fbb5c074375b1a54e Jun 16 19:59:17.778696 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:17.778656 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dc455d58-5t87n" event={"ID":"dceff386-f5ed-4c86-89e8-506743bc322e","Type":"ContainerStarted","Data":"71986a1fef615630991034422ba3a8d4f803da32a9a42d2fbb5c074375b1a54e"} Jun 16 19:59:19.795739 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:19.795702 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dc455d58-5t87n" event={"ID":"dceff386-f5ed-4c86-89e8-506743bc322e","Type":"ContainerStarted","Data":"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb"} Jun 16 19:59:19.796169 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:19.795847 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:19.828661 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:19.828612 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dc455d58-5t87n" podStartSLOduration=1.999654798 podStartE2EDuration="3.828595025s" totalImagesPullingTime="1.828940227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 19:59:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 19:59:19.827045331 +0000 UTC m=+612.306105839" watchObservedRunningTime="2026-06-16 19:59:19.828595025 +0000 UTC m=+612.307655547" Jun 16 19:59:30.808085 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:30.808053 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 19:59:50.903864 ip-10-0-139-232 kubenswrapper[2576]: I0616 19:59:50.903823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:00:02.004266 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:02.004227 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:02.004798 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:02.004447 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" containerID="cri-o://c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7" gracePeriod=30 Jun 16 20:00:03.654369 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.654339 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:03.795296 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.795207 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrpjj\" (UniqueName: \"kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj\") pod \"f3c31abb-bd6e-49cb-a95f-d1903b848e34\" (UID: \"f3c31abb-bd6e-49cb-a95f-d1903b848e34\") " Jun 16 20:00:03.797423 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.797391 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj" (OuterVolumeSpecName: "kube-api-access-xrpjj") pod "f3c31abb-bd6e-49cb-a95f-d1903b848e34" (UID: "f3c31abb-bd6e-49cb-a95f-d1903b848e34"). InnerVolumeSpecName "kube-api-access-xrpjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:00:03.896791 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.896751 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrpjj\" (UniqueName: \"kubernetes.io/projected/f3c31abb-bd6e-49cb-a95f-d1903b848e34-kube-api-access-xrpjj\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 20:00:03.994637 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.994601 2576 generic.go:356] "Generic (PLEG): container finished" podID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerID="c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7" exitCode=143 Jun 16 20:00:03.994823 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.994696 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:03.995416 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.995395 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3c31abb-bd6e-49cb-a95f-d1903b848e34","Type":"ContainerDied","Data":"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7"} Jun 16 20:00:03.995497 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.995448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"f3c31abb-bd6e-49cb-a95f-d1903b848e34","Type":"ContainerDied","Data":"09ac7eac328a86650796501d2c1df34352969339e64523e455dd52ac03dc2d61"} Jun 16 20:00:03.995497 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:03.995480 2576 scope.go:117] "RemoveContainer" containerID="c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7" Jun 16 20:00:04.005033 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.005014 2576 scope.go:117] "RemoveContainer" containerID="c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7" Jun 16 20:00:04.005461 ip-10-0-139-232 kubenswrapper[2576]: E0616 20:00:04.005416 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7\": container with ID starting with c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7 not found: ID does not exist" containerID="c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7" Jun 16 20:00:04.005555 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.005498 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7"} err="failed to get container status \"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7\": rpc error: code = NotFound desc = could not find container \"c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7\": container with ID starting with c1d8eb5a005504d17e416e353a08645d7f7d9ed765b613755c6d884fb06dc7d7 not found: ID does not exist" Jun 16 20:00:04.038057 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.038023 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:04.042329 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.042302 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:04.094291 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.094216 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:04.094596 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.094583 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" Jun 16 20:00:04.094647 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.094598 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" Jun 16 20:00:04.094681 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.094651 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" containerName="keycloak" Jun 16 20:00:04.098970 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.098950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.102906 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.102886 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 16 20:00:04.103022 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.102887 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 16 20:00:04.103245 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.103228 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 16 20:00:04.103311 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.103243 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-7wgbj\"" Jun 16 20:00:04.103311 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.103234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 16 20:00:04.120512 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.120489 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:04.199134 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.199097 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/997e56ee-3e0b-4917-b487-628789847b70-test-realms\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.199134 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.199134 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv2lk\" (UniqueName: \"kubernetes.io/projected/997e56ee-3e0b-4917-b487-628789847b70-kube-api-access-rv2lk\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.300005 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.299970 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/997e56ee-3e0b-4917-b487-628789847b70-test-realms\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.300005 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.300006 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv2lk\" (UniqueName: \"kubernetes.io/projected/997e56ee-3e0b-4917-b487-628789847b70-kube-api-access-rv2lk\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.300712 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.300691 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/997e56ee-3e0b-4917-b487-628789847b70-test-realms\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.316402 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.316375 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv2lk\" (UniqueName: \"kubernetes.io/projected/997e56ee-3e0b-4917-b487-628789847b70-kube-api-access-rv2lk\") pod \"maas-keycloak-0\" (UID: \"997e56ee-3e0b-4917-b487-628789847b70\") " pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.408749 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.408713 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:04.553576 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.553546 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 16 20:00:04.557111 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:00:04.557081 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997e56ee_3e0b_4917_b487_628789847b70.slice/crio-9f6bbb09f70c092f05b3f57671101117e5272725faab0a2bbdd4dc04c405dc85 WatchSource:0}: Error finding container 9f6bbb09f70c092f05b3f57671101117e5272725faab0a2bbdd4dc04c405dc85: Status 404 returned error can't find the container with id 9f6bbb09f70c092f05b3f57671101117e5272725faab0a2bbdd4dc04c405dc85 Jun 16 20:00:04.558672 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:04.558645 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 20:00:05.000721 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:05.000687 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"997e56ee-3e0b-4917-b487-628789847b70","Type":"ContainerStarted","Data":"9f6bbb09f70c092f05b3f57671101117e5272725faab0a2bbdd4dc04c405dc85"} Jun 16 20:00:05.997381 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:05.997344 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c31abb-bd6e-49cb-a95f-d1903b848e34" path="/var/lib/kubelet/pods/f3c31abb-bd6e-49cb-a95f-d1903b848e34/volumes" Jun 16 20:00:06.006993 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:06.006958 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"997e56ee-3e0b-4917-b487-628789847b70","Type":"ContainerStarted","Data":"7f15d835c4cacc51cb60dc17b4f3106379885f5991d1265444d990fc787f2b57"} Jun 16 20:00:06.041977 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:06.041909 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.3854393950000001 podStartE2EDuration="2.041884721s" totalImagesPullingTime="656.445326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:00:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:00:06.039229192 +0000 UTC m=+658.518289694" watchObservedRunningTime="2026-06-16 20:00:06.041884721 +0000 UTC m=+658.520945200" Jun 16 20:00:06.409045 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:06.409001 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:06.410358 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:06.410329 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:07.409406 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:07.409356 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:08.409546 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:08.409495 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:09.409700 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:09.409639 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:10.409425 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:10.409378 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:11.410088 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:11.410032 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:12.409843 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:12.409791 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:13.410134 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:13.410086 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:14.409023 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:14.408973 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:14.409364 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:14.409330 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:15.409303 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:15.409251 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:16.409690 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:16.409639 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:17.409869 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:17.409824 2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 16 20:00:18.507698 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:18.507662 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 16 20:00:18.527289 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:18.527242 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 16 20:00:28.512450 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:28.512377 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="997e56ee-3e0b-4917-b487-628789847b70" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 16 20:00:38.513548 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:00:38.513508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 16 20:01:00.896703 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:00.896663 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:01:08.176141 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.176106 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd"] Jun 16 20:01:08.180224 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.180202 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.184014 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.183989 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 16 20:01:08.184172 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.184022 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 16 20:01:08.184172 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.183989 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mrjxh\"" Jun 16 20:01:08.184172 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.184074 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 16 20:01:08.188233 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.188211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd"] Jun 16 20:01:08.295666 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.295632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.295666 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.295669 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.295913 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.295700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.295913 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.295808 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wtjf\" (UniqueName: \"kubernetes.io/projected/0596a036-f61c-4886-8186-abc51f0d3bc3-kube-api-access-9wtjf\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.295913 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.295868 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0596a036-f61c-4886-8186-abc51f0d3bc3-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396344 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396310 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396344 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396347 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396592 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396405 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396592 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396466 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wtjf\" (UniqueName: \"kubernetes.io/projected/0596a036-f61c-4886-8186-abc51f0d3bc3-kube-api-access-9wtjf\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396676 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396598 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0596a036-f61c-4886-8186-abc51f0d3bc3-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.396941 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396914 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-model-cache\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.397047 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.396915 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-home\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.398616 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.398590 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0596a036-f61c-4886-8186-abc51f0d3bc3-dshm\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.398904 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.398886 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0596a036-f61c-4886-8186-abc51f0d3bc3-tls-certs\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.405452 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.405421 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wtjf\" (UniqueName: \"kubernetes.io/projected/0596a036-f61c-4886-8186-abc51f0d3bc3-kube-api-access-9wtjf\") pod \"e2e-distinct-simulated-kserve-ff95456df-2qwbd\" (UID: \"0596a036-f61c-4886-8186-abc51f0d3bc3\") " pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.490722 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.490624 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:08.640653 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.640623 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd"] Jun 16 20:01:08.641535 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:01:08.641506 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0596a036_f61c_4886_8186_abc51f0d3bc3.slice/crio-e4d11f07faacec1b303d7d621c06367d50354700f831e9e65a32f0422d49a747 WatchSource:0}: Error finding container e4d11f07faacec1b303d7d621c06367d50354700f831e9e65a32f0422d49a747: Status 404 returned error can't find the container with id e4d11f07faacec1b303d7d621c06367d50354700f831e9e65a32f0422d49a747 Jun 16 20:01:08.899480 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:08.899382 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:01:09.334049 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:09.333962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" event={"ID":"0596a036-f61c-4886-8186-abc51f0d3bc3","Type":"ContainerStarted","Data":"e4d11f07faacec1b303d7d621c06367d50354700f831e9e65a32f0422d49a747"} Jun 16 20:01:10.340096 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:10.340057 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" event={"ID":"0596a036-f61c-4886-8186-abc51f0d3bc3","Type":"ContainerStarted","Data":"337edecee2038652f30eed23dc68e13b7bedf0a49b36078a86da9bee2d84120c"} Jun 16 20:01:10.360679 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:10.360624 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" podStartSLOduration=1.254097203 podStartE2EDuration="2.360608841s" totalImagesPullingTime="1.106511638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:10.358829255 +0000 UTC m=+722.837889753" watchObservedRunningTime="2026-06-16 20:01:10.360608841 +0000 UTC m=+722.839669327" Jun 16 20:01:18.491327 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:18.491288 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:18.491748 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:18.491371 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:18.504108 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:18.504079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:19.399316 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:19.399288 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-ff95456df-2qwbd" Jun 16 20:01:28.299329 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.299296 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk"] Jun 16 20:01:28.302665 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.302644 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.305956 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.305938 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 16 20:01:28.315225 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.315200 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk"] Jun 16 20:01:28.479542 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.479490 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq68q\" (UniqueName: \"kubernetes.io/projected/e7333940-54f1-494e-b8e5-66a0572853c7-kube-api-access-lq68q\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.479542 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.479540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7333940-54f1-494e-b8e5-66a0572853c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.479772 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.479567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.479772 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.479607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.479772 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.479627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581101 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq68q\" (UniqueName: \"kubernetes.io/projected/e7333940-54f1-494e-b8e5-66a0572853c7-kube-api-access-lq68q\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581101 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7333940-54f1-494e-b8e5-66a0572853c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581101 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581083 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581336 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581111 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581336 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581129 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581584 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581568 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-model-cache\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.581660 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.581640 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-home\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.583426 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.583408 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7333940-54f1-494e-b8e5-66a0572853c7-dshm\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.583736 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.583716 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7333940-54f1-494e-b8e5-66a0572853c7-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.591014 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.590989 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq68q\" (UniqueName: \"kubernetes.io/projected/e7333940-54f1-494e-b8e5-66a0572853c7-kube-api-access-lq68q\") pod \"e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk\" (UID: \"e7333940-54f1-494e-b8e5-66a0572853c7\") " pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.612911 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.612882 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:28.749804 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:28.749779 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk"] Jun 16 20:01:28.751870 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:01:28.751843 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7333940_54f1_494e_b8e5_66a0572853c7.slice/crio-1b86c26d24a1a275107187acb1d560784b2c666b422622a534be808fd7acf2fe WatchSource:0}: Error finding container 1b86c26d24a1a275107187acb1d560784b2c666b422622a534be808fd7acf2fe: Status 404 returned error can't find the container with id 1b86c26d24a1a275107187acb1d560784b2c666b422622a534be808fd7acf2fe Jun 16 20:01:29.108995 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:29.108953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:01:29.434809 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:29.434774 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" event={"ID":"e7333940-54f1-494e-b8e5-66a0572853c7","Type":"ContainerStarted","Data":"1b86c26d24a1a275107187acb1d560784b2c666b422622a534be808fd7acf2fe"} Jun 16 20:01:30.440539 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:30.440502 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" event={"ID":"e7333940-54f1-494e-b8e5-66a0572853c7","Type":"ContainerStarted","Data":"9bbbeeceac8a4cd3dd4d8fdaf1ba325972a1088653549c8ef7db9d5a9fa9e779"} Jun 16 20:01:30.461240 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:30.461195 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" podStartSLOduration=1.718729175 podStartE2EDuration="2.46117808s" totalImagesPullingTime="742.448905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:01:30.45963575 +0000 UTC m=+742.938696254" watchObservedRunningTime="2026-06-16 20:01:30.46117808 +0000 UTC m=+742.940238557" Jun 16 20:01:38.613873 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:38.613833 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:38.614526 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:38.613903 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:38.626232 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:38.626199 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:39.492362 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:39.492333 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk" Jun 16 20:01:41.003565 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:41.003525 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:01:46.028591 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:46.028553 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:01:51.598967 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:01:51.598923 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:03:23.336486 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.336430 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:03:23.339235 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.339213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.352061 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.352030 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:03:23.406412 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.406356 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9r72\" (UniqueName: \"kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.406610 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.406500 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.507283 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.507241 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9r72\" (UniqueName: \"kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.507472 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.507329 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.509738 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.509709 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.519953 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.519928 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9r72\" (UniqueName: \"kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72\") pod \"maas-controller-55b496454d-w7wrk\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.651406 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.651377 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:23.787149 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.787122 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:03:23.788243 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:03:23.788218 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb841bbee_662a_4436_9428_9577c5732ce7.slice/crio-94f0db3ab2804be7f114d51ddcf16265dfc5883d126a6a534011b7c3a7c16145 WatchSource:0}: Error finding container 94f0db3ab2804be7f114d51ddcf16265dfc5883d126a6a534011b7c3a7c16145: Status 404 returned error can't find the container with id 94f0db3ab2804be7f114d51ddcf16265dfc5883d126a6a534011b7c3a7c16145 Jun 16 20:03:23.956966 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:23.956869 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-w7wrk" event={"ID":"b841bbee-662a-4436-9428-9577c5732ce7","Type":"ContainerStarted","Data":"94f0db3ab2804be7f114d51ddcf16265dfc5883d126a6a534011b7c3a7c16145"} Jun 16 20:03:24.962476 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:24.962416 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-w7wrk" event={"ID":"b841bbee-662a-4436-9428-9577c5732ce7","Type":"ContainerStarted","Data":"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b"} Jun 16 20:03:24.962906 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:24.962490 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:25.007827 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:25.007779 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b496454d-w7wrk" podStartSLOduration=1.181553398 podStartE2EDuration="2.007763392s" totalImagesPullingTime="826.209994ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:03:25.007677351 +0000 UTC m=+857.486737873" watchObservedRunningTime="2026-06-16 20:03:25.007763392 +0000 UTC m=+857.486823870" Jun 16 20:03:35.973011 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:35.972977 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:03:36.025254 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.025218 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 20:03:36.025518 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.025492 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-74dc455d58-5t87n" podUID="dceff386-f5ed-4c86-89e8-506743bc322e" containerName="manager" containerID="cri-o://3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb" gracePeriod=30 Jun 16 20:03:36.276921 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.276896 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 20:03:36.323908 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.323870 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zmq9k\" (UniqueName: \"kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k\") pod \"dceff386-f5ed-4c86-89e8-506743bc322e\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " Jun 16 20:03:36.324100 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.323931 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert\") pod \"dceff386-f5ed-4c86-89e8-506743bc322e\" (UID: \"dceff386-f5ed-4c86-89e8-506743bc322e\") " Jun 16 20:03:36.326093 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.326069 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k" (OuterVolumeSpecName: "kube-api-access-zmq9k") pod "dceff386-f5ed-4c86-89e8-506743bc322e" (UID: "dceff386-f5ed-4c86-89e8-506743bc322e"). InnerVolumeSpecName "kube-api-access-zmq9k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:03:36.326093 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.326084 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dceff386-f5ed-4c86-89e8-506743bc322e" (UID: "dceff386-f5ed-4c86-89e8-506743bc322e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 20:03:36.425699 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.425658 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dceff386-f5ed-4c86-89e8-506743bc322e-webhook-cert\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 20:03:36.425699 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:36.425693 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zmq9k\" (UniqueName: \"kubernetes.io/projected/dceff386-f5ed-4c86-89e8-506743bc322e-kube-api-access-zmq9k\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 20:03:37.021988 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.021949 2576 generic.go:356] "Generic (PLEG): container finished" podID="dceff386-f5ed-4c86-89e8-506743bc322e" containerID="3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb" exitCode=0 Jun 16 20:03:37.022462 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.022014 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dc455d58-5t87n" Jun 16 20:03:37.022462 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.022039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dc455d58-5t87n" event={"ID":"dceff386-f5ed-4c86-89e8-506743bc322e","Type":"ContainerDied","Data":"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb"} Jun 16 20:03:37.022462 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.022091 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dc455d58-5t87n" event={"ID":"dceff386-f5ed-4c86-89e8-506743bc322e","Type":"ContainerDied","Data":"71986a1fef615630991034422ba3a8d4f803da32a9a42d2fbb5c074375b1a54e"} Jun 16 20:03:37.022462 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.022112 2576 scope.go:117] "RemoveContainer" containerID="3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb" Jun 16 20:03:37.031273 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.031148 2576 scope.go:117] "RemoveContainer" containerID="3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb" Jun 16 20:03:37.031459 ip-10-0-139-232 kubenswrapper[2576]: E0616 20:03:37.031421 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb\": container with ID starting with 3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb not found: ID does not exist" containerID="3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb" Jun 16 20:03:37.031518 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.031473 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb"} err="failed to get container status \"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb\": rpc error: code = NotFound desc = could not find container \"3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb\": container with ID starting with 3bd471be12f75c771c84f34dff55a24f32ce77d097e41bb8941a3f1ab31fb3cb not found: ID does not exist" Jun 16 20:03:37.045667 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.045636 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 20:03:37.049624 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.049600 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74dc455d58-5t87n"] Jun 16 20:03:37.995161 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:37.995126 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dceff386-f5ed-4c86-89e8-506743bc322e" path="/var/lib/kubelet/pods/dceff386-f5ed-4c86-89e8-506743bc322e/volumes" Jun 16 20:03:56.427954 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:03:56.427918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:00.704839 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:00.704803 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:06.404228 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:06.404188 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:08.011512 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:08.011481 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:04:08.013364 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:08.013343 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:04:16.926129 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:16.926090 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:26.601869 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:26.601831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:36.411354 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:36.411314 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:46.097289 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:46.097250 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:04:55.305512 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:04:55.305473 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:05:03.031598 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.031546 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:05:03.032115 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.031777 2576 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-55b496454d-w7wrk" podUID="b841bbee-662a-4436-9428-9577c5732ce7" containerName="manager" containerID="cri-o://1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b" gracePeriod=30 Jun 16 20:05:03.283554 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.283485 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:05:03.416143 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.416103 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9r72\" (UniqueName: \"kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72\") pod \"b841bbee-662a-4436-9428-9577c5732ce7\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " Jun 16 20:05:03.416315 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.416153 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert\") pod \"b841bbee-662a-4436-9428-9577c5732ce7\" (UID: \"b841bbee-662a-4436-9428-9577c5732ce7\") " Jun 16 20:05:03.418250 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.418215 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72" (OuterVolumeSpecName: "kube-api-access-b9r72") pod "b841bbee-662a-4436-9428-9577c5732ce7" (UID: "b841bbee-662a-4436-9428-9577c5732ce7"). InnerVolumeSpecName "kube-api-access-b9r72". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 16 20:05:03.418370 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.418318 2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b841bbee-662a-4436-9428-9577c5732ce7" (UID: "b841bbee-662a-4436-9428-9577c5732ce7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 16 20:05:03.422548 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.422523 2576 generic.go:356] "Generic (PLEG): container finished" podID="b841bbee-662a-4436-9428-9577c5732ce7" containerID="1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b" exitCode=0 Jun 16 20:05:03.422682 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.422565 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-w7wrk" Jun 16 20:05:03.422682 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.422598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-w7wrk" event={"ID":"b841bbee-662a-4436-9428-9577c5732ce7","Type":"ContainerDied","Data":"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b"} Jun 16 20:05:03.422682 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.422649 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-w7wrk" event={"ID":"b841bbee-662a-4436-9428-9577c5732ce7","Type":"ContainerDied","Data":"94f0db3ab2804be7f114d51ddcf16265dfc5883d126a6a534011b7c3a7c16145"} Jun 16 20:05:03.422682 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.422670 2576 scope.go:117] "RemoveContainer" containerID="1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b" Jun 16 20:05:03.438139 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.438120 2576 scope.go:117] "RemoveContainer" containerID="1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b" Jun 16 20:05:03.438643 ip-10-0-139-232 kubenswrapper[2576]: E0616 20:05:03.438616 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b\": container with ID starting with 1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b not found: ID does not exist" containerID="1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b" Jun 16 20:05:03.438730 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.438657 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b"} err="failed to get container status \"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b\": rpc error: code = NotFound desc = could not find container \"1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b\": container with ID starting with 1ab36c1957da8a0303a4d440ea4aa1a4220faafce08d1006fe2990d1b093073b not found: ID does not exist" Jun 16 20:05:03.452623 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.452594 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:05:03.454229 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.454205 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-55b496454d-w7wrk"] Jun 16 20:05:03.517290 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.517260 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9r72\" (UniqueName: \"kubernetes.io/projected/b841bbee-662a-4436-9428-9577c5732ce7-kube-api-access-b9r72\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 20:05:03.517290 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.517288 2576 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b841bbee-662a-4436-9428-9577c5732ce7-webhook-cert\") on node \"ip-10-0-139-232.ec2.internal\" DevicePath \"\"" Jun 16 20:05:03.995214 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:03.995176 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b841bbee-662a-4436-9428-9577c5732ce7" path="/var/lib/kubelet/pods/b841bbee-662a-4436-9428-9577c5732ce7/volumes" Jun 16 20:05:04.267959 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.267883 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-55b496454d-mxjvz"] Jun 16 20:05:04.268340 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268323 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dceff386-f5ed-4c86-89e8-506743bc322e" containerName="manager" Jun 16 20:05:04.268387 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268343 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="dceff386-f5ed-4c86-89e8-506743bc322e" containerName="manager" Jun 16 20:05:04.268387 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268358 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b841bbee-662a-4436-9428-9577c5732ce7" containerName="manager" Jun 16 20:05:04.268387 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268367 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="b841bbee-662a-4436-9428-9577c5732ce7" containerName="manager" Jun 16 20:05:04.268509 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268451 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="b841bbee-662a-4436-9428-9577c5732ce7" containerName="manager" Jun 16 20:05:04.268509 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.268460 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="dceff386-f5ed-4c86-89e8-506743bc322e" containerName="manager" Jun 16 20:05:04.271092 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.271077 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.274759 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.274726 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-5b658\"" Jun 16 20:05:04.274910 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.274728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 16 20:05:04.274910 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.274803 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 16 20:05:04.284288 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.284260 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b496454d-mxjvz"] Jun 16 20:05:04.324151 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.324118 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92wrh\" (UniqueName: \"kubernetes.io/projected/054a8262-da4e-4a61-a2f1-a23ca0ee7686-kube-api-access-92wrh\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.324323 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.324165 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/054a8262-da4e-4a61-a2f1-a23ca0ee7686-webhook-cert\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.424767 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.424738 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92wrh\" (UniqueName: \"kubernetes.io/projected/054a8262-da4e-4a61-a2f1-a23ca0ee7686-kube-api-access-92wrh\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.424934 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.424782 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/054a8262-da4e-4a61-a2f1-a23ca0ee7686-webhook-cert\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.427244 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.427218 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/054a8262-da4e-4a61-a2f1-a23ca0ee7686-webhook-cert\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.435028 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.435001 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92wrh\" (UniqueName: \"kubernetes.io/projected/054a8262-da4e-4a61-a2f1-a23ca0ee7686-kube-api-access-92wrh\") pod \"maas-controller-55b496454d-mxjvz\" (UID: \"054a8262-da4e-4a61-a2f1-a23ca0ee7686\") " pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.581474 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.581353 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:04.920501 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.920455 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-55b496454d-mxjvz"] Jun 16 20:05:04.922746 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:05:04.922714 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod054a8262_da4e_4a61_a2f1_a23ca0ee7686.slice/crio-9de1186bb49bc75ef1b8ab6f847cc6a5ffdec865b7eccd1c89b8d7dbfbd102e1 WatchSource:0}: Error finding container 9de1186bb49bc75ef1b8ab6f847cc6a5ffdec865b7eccd1c89b8d7dbfbd102e1: Status 404 returned error can't find the container with id 9de1186bb49bc75ef1b8ab6f847cc6a5ffdec865b7eccd1c89b8d7dbfbd102e1 Jun 16 20:05:04.924107 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:04.924091 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 16 20:05:05.434371 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:05.434332 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-mxjvz" event={"ID":"054a8262-da4e-4a61-a2f1-a23ca0ee7686","Type":"ContainerStarted","Data":"9de1186bb49bc75ef1b8ab6f847cc6a5ffdec865b7eccd1c89b8d7dbfbd102e1"} Jun 16 20:05:06.440139 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:06.440099 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-55b496454d-mxjvz" event={"ID":"054a8262-da4e-4a61-a2f1-a23ca0ee7686","Type":"ContainerStarted","Data":"bd53701a8e9fb10fd66e83d5ef45522542891aa38c23b77a416eb3f009fac525"} Jun 16 20:05:06.440638 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:06.440156 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:06.459410 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:06.459343 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-55b496454d-mxjvz" podStartSLOduration=1.93397978 podStartE2EDuration="2.459326805s" totalImagesPullingTime="525.347025ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-16 20:05:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:05:06.45852335 +0000 UTC m=+958.937583846" watchObservedRunningTime="2026-06-16 20:05:06.459326805 +0000 UTC m=+958.938387260" Jun 16 20:05:17.451820 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:17.451787 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-55b496454d-mxjvz" Jun 16 20:05:28.848212 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:28.848126 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:05:32.698790 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:32.698753 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:05:44.996770 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:44.996731 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:05:50.297020 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:05:50.296981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:06:27.089672 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:06:27.089629 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:06:36.097417 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:06:36.095350 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:06:52.904314 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:06:52.904226 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:07:01.438726 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:07:01.438687 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:07:19.005077 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:07:19.005039 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:07:27.193698 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:07:27.193657 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:07:59.892524 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:07:59.892485 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:07.903092 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:07.903052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:10.915667 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:10.915630 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:17.599195 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:17.599152 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:24.926736 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:24.926644 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:33.511464 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:33.511415 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:42.318673 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:42.318639 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:46.198685 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:46.198648 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:08:58.886600 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:08:58.886564 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:09:08.038590 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:09:08.038558 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:09:08.047351 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:09:08.047327 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:09:13.008261 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:09:13.008224 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:09:41.791102 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:09:41.791065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:09:44.390838 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:09:44.390794 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:02.207649 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:02.207559 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:08.930752 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:08.930706 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:27.995621 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:27.995591 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:33.096422 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:33.096381 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:36.896506 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:36.896469 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:46.904121 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:46.904076 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:10:53.797851 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:10:53.797808 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:04.695103 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:04.695065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:11.600504 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:11.600464 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:22.089969 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:22.089882 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:28.395615 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:28.395577 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:37.501718 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:37.501680 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:11:45.792312 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:11:45.792273 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:14:08.074631 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:08.074602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:14:08.077810 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:08.077785 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:14:10.300555 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:10.300517 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:14:15.307360 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:15.307324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:14:40.121188 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:40.121147 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:14:44.792510 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:44.792463 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:14:54.341604 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:14:54.341558 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:04.423901 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:04.423866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:13.643940 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:13.643900 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:24.402521 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:24.402482 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:33.136503 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:33.136466 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:43.713505 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:43.713470 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:15:52.432295 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:15:52.432216 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:16:02.195128 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:16:02.195084 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:16:12.117743 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:16:12.117703 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:16:46.999007 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:16:46.998971 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:17:30.207476 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:17:30.207363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:17:38.918788 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:17:38.918749 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:17:47.406793 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:17:47.406752 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:17:56.000806 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:17:56.000768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:04.692863 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:04.692823 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:17.404772 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:17.404736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:26.297652 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:26.297617 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:31.510466 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:31.510419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:38.516949 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:38.516885 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:47.120615 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:47.120575 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:18:55.045495 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:18:55.045408 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:19:05.709784 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:05.709741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:19:08.102791 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:08.102763 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:19:08.106939 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:08.106918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:19:23.497820 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:23.497781 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:19:32.430015 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:32.429978 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:19:40.999151 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:40.999115 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:19:49.323734 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:19:49.323694 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:06.493215 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:06.493172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:15.055324 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:15.055282 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:23.597870 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:23.597789 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:32.008174 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:32.008136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:40.897932 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:40.897897 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:49.704084 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:49.704048 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:20:58.399582 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:20:58.399543 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:11.342263 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:11.342219 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:20.505744 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:20.505702 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:33.890857 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:33.890817 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:42.795398 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:42.795354 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:48.492788 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:48.492752 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:21:55.910056 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:21:55.909965 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:22:01.506149 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:22:01.506113 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:22:17.532354 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:22:17.532313 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:22:26.395230 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:22:26.395191 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:22:35.698981 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:22:35.698939 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:22:41.600995 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:22:41.600955 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:23:05.403311 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:23:05.403277 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:23:18.032511 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:23:18.032474 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:24:08.130495 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:24:08.130463 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:24:08.136072 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:24:08.136052 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xsgmv_faf7353a-f06c-4cf6-bff3-cb589cb12d36/ovn-acl-logging/0.log" Jun 16 20:25:39.692392 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:25:39.692351 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:25:44.394056 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:25:44.394016 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:25:50.237370 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:25:50.237336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:26:48.000623 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:26:48.000587 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:26:53.505274 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:26:53.505238 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:26:59.997180 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:26:59.997143 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:27:07.798928 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:27:07.798891 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-9pxbd"] Jun 16 20:28:04.720795 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:04.720711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55b496454d-mxjvz_054a8262-da4e-4a61-a2f1-a23ca0ee7686/manager/0.log" Jun 16 20:28:05.096950 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:05.096850 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-4dphv_8dd29b7d-4ca7-4275-8653-16a54cf60f3f/copy-manifests/0.log" Jun 16 20:28:05.117170 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:05.117144 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-4dphv_8dd29b7d-4ca7-4275-8653-16a54cf60f3f/manager/0.log" Jun 16 20:28:07.135770 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:07.135741 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-28n8p_08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6/kuadrant-console-plugin/0.log" Jun 16 20:28:07.476447 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:07.476415 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9pxbd_80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47/limitador/0.log" Jun 16 20:28:08.159356 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:08.159329 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-6tskx_2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf/kube-auth-proxy/0.log" Jun 16 20:28:09.185909 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:09.185876 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-ff95456df-2qwbd_0596a036-f61c-4886-8186-abc51f0d3bc3/main/0.log" Jun 16 20:28:09.309403 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:09.309368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-74dcdbf7f6-hcgdk_e7333940-54f1-494e-b8e5-66a0572853c7/main/0.log" Jun 16 20:28:17.042463 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:17.042411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6mfpr_79c1f5ea-5f3f-496d-82df-ee92bc14dcb9/global-pull-secret-syncer/0.log" Jun 16 20:28:17.434926 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:17.434892 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-x62cp_63814b2c-fc48-4715-9508-2357758d6f40/konnectivity-agent/0.log" Jun 16 20:28:17.533511 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:17.533479 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-232.ec2.internal_4eb95cf55887de53e5ea257c2ce412d4/haproxy/0.log" Jun 16 20:28:22.217416 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:22.217382 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-28n8p_08dbd61a-8c4d-4eff-ba81-974ffdb7a6e6/kuadrant-console-plugin/0.log" Jun 16 20:28:22.456431 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:22.456406 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-9pxbd_80bdaa32-7f88-4a5a-a8fc-480bc8ff5d47/limitador/0.log" Jun 16 20:28:24.606669 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.606630 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rr5r5_c4c25d88-ece2-45e1-bae0-2fbc963d08cc/kube-state-metrics/0.log" Jun 16 20:28:24.632610 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.632574 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rr5r5_c4c25d88-ece2-45e1-bae0-2fbc963d08cc/kube-rbac-proxy-main/0.log" Jun 16 20:28:24.661713 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.661636 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-rr5r5_c4c25d88-ece2-45e1-bae0-2fbc963d08cc/kube-rbac-proxy-self/0.log" Jun 16 20:28:24.697095 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.697067 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-644967dcb9-b6lww_cc941021-d5f6-4bc8-9b76-633af5319ff9/metrics-server/0.log" Jun 16 20:28:24.742396 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.742361 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-h7qxb_0d367536-b292-416b-baf3-5174073df7bc/monitoring-plugin/0.log" Jun 16 20:28:24.935254 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.935171 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwwjv_dd4ca699-eab1-4c4a-beb1-8bb76650ee34/node-exporter/0.log" Jun 16 20:28:24.982179 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:24.982150 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwwjv_dd4ca699-eab1-4c4a-beb1-8bb76650ee34/kube-rbac-proxy/0.log" Jun 16 20:28:25.019303 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.019273 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-kwwjv_dd4ca699-eab1-4c4a-beb1-8bb76650ee34/init-textfile/0.log" Jun 16 20:28:25.243918 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.243877 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-mb8vc_8726b13c-caa6-45f0-b887-15c9c1d33726/kube-rbac-proxy-main/0.log" Jun 16 20:28:25.293485 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.293456 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-mb8vc_8726b13c-caa6-45f0-b887-15c9c1d33726/kube-rbac-proxy-self/0.log" Jun 16 20:28:25.328329 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.328298 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-mb8vc_8726b13c-caa6-45f0-b887-15c9c1d33726/openshift-state-metrics/0.log" Jun 16 20:28:25.386883 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.386853 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/prometheus/0.log" Jun 16 20:28:25.424461 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.424411 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/config-reloader/0.log" Jun 16 20:28:25.460093 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.460015 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/thanos-sidecar/0.log" Jun 16 20:28:25.495187 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.495155 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/kube-rbac-proxy-web/0.log" Jun 16 20:28:25.530112 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.530082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/kube-rbac-proxy/0.log" Jun 16 20:28:25.562046 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.562001 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/kube-rbac-proxy-thanos/0.log" Jun 16 20:28:25.595295 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.595263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_8e640d98-4b91-4d7b-9387-74e8a0504450/init-config-reloader/0.log" Jun 16 20:28:25.642169 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.642109 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-96nbj_6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3/prometheus-operator/0.log" Jun 16 20:28:25.678689 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.678661 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-96nbj_6f8b94cd-b9a7-49ac-b5b9-3096786d4bb3/kube-rbac-proxy/0.log" Jun 16 20:28:25.723765 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.723694 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5cf667749c-kkwn8_ad63b7ca-39e5-43cf-a725-f5732d1f3e7a/prometheus-operator-admission-webhook/0.log" Jun 16 20:28:25.901333 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.901295 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/thanos-query/0.log" Jun 16 20:28:25.961779 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:25.961754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/kube-rbac-proxy-web/0.log" Jun 16 20:28:26.001549 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:26.001471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/kube-rbac-proxy/0.log" Jun 16 20:28:26.078412 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:26.078385 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/prom-label-proxy/0.log" Jun 16 20:28:26.191734 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:26.191708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/kube-rbac-proxy-rules/0.log" Jun 16 20:28:26.285417 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:26.285324 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-8bd545db9-b4zz9_59f41e39-61ad-4da7-8d92-bb2a3b75f04f/kube-rbac-proxy-metrics/0.log" Jun 16 20:28:28.526870 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.526834 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx"] Jun 16 20:28:28.530765 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.530745 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.533473 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.533431 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"openshift-service-ca.crt\"" Jun 16 20:28:28.534534 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.534512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-tqlq7\"/\"default-dockercfg-mg6j4\"" Jun 16 20:28:28.534629 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.534513 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-tqlq7\"/\"kube-root-ca.crt\"" Jun 16 20:28:28.540934 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.540911 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx"] Jun 16 20:28:28.687681 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.687642 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-sys\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.687866 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.687694 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-proc\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.687866 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.687795 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-lib-modules\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.687866 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.687823 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-podres\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.687866 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.687848 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bncc7\" (UniqueName: \"kubernetes.io/projected/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-kube-api-access-bncc7\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789232 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789142 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-lib-modules\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789232 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789177 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-podres\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789232 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789210 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bncc7\" (UniqueName: \"kubernetes.io/projected/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-kube-api-access-bncc7\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789274 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-sys\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-proc\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-lib-modules\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789326 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-podres\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789368 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-sys\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.789522 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.789411 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-proc\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.798861 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.798828 2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bncc7\" (UniqueName: \"kubernetes.io/projected/4f841cfe-6fd4-4bc9-b057-8b0e809f15eb-kube-api-access-bncc7\") pod \"perf-node-gather-daemonset-46wdx\" (UID: \"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb\") " pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.840964 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.840928 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:28.965199 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.965146 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-9cnsn_e949bae5-818c-49ff-b473-dd35ef21398d/download-server/0.log" Jun 16 20:28:28.976932 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:28.976905 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx"] Jun 16 20:28:28.979156 ip-10-0-139-232 kubenswrapper[2576]: W0616 20:28:28.979131 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4f841cfe_6fd4_4bc9_b057_8b0e809f15eb.slice/crio-935fc9d583961e7374da45986f61d65a4b578e91a44d877a765a504c0e126280 WatchSource:0}: Error finding container 935fc9d583961e7374da45986f61d65a4b578e91a44d877a765a504c0e126280: Status 404 returned error can't find the container with id 935fc9d583961e7374da45986f61d65a4b578e91a44d877a765a504c0e126280 Jun 16 20:28:29.904711 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:29.904674 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" event={"ID":"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb","Type":"ContainerStarted","Data":"30da3cd55442b0502aa71256e69a6fe113ca8a36a7221c7661e8bf171dedf211"} Jun 16 20:28:29.905096 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:29.904726 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" event={"ID":"4f841cfe-6fd4-4bc9-b057-8b0e809f15eb","Type":"ContainerStarted","Data":"935fc9d583961e7374da45986f61d65a4b578e91a44d877a765a504c0e126280"} Jun 16 20:28:29.905096 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:29.904816 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:29.929553 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:29.929507 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" podStartSLOduration=1.929491174 podStartE2EDuration="1.929491174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-16 20:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-16 20:28:29.928088087 +0000 UTC m=+2362.407148566" watchObservedRunningTime="2026-06-16 20:28:29.929491174 +0000 UTC m=+2362.408551651" Jun 16 20:28:30.898151 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:30.898118 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ndjxd_2d4be6fa-b16e-42de-a74e-a3f04bbadc92/dns/0.log" Jun 16 20:28:30.926787 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:30.926760 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ndjxd_2d4be6fa-b16e-42de-a74e-a3f04bbadc92/kube-rbac-proxy/0.log" Jun 16 20:28:31.046795 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:31.046765 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-99zv5_783d336e-36c9-449a-a88c-4b277c73ed72/dns-node-resolver/0.log" Jun 16 20:28:31.661582 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:31.661553 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75ff55c459-s46mv_f9d22114-5295-49ad-8e43-c928fde446b9/registry/0.log" Jun 16 20:28:31.717907 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:31.717876 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jm8mm_3bd96be0-3cef-435e-9749-b822ffee261e/node-ca/0.log" Jun 16 20:28:32.991837 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:32.991802 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-6tskx_2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf/kube-auth-proxy/0.log" Jun 16 20:28:34.070032 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:34.069994 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-crcpl_9fc86f03-b68c-4e5c-ae77-15e323efb287/serve-healthcheck-canary/0.log" Jun 16 20:28:34.820816 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:34.820783 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvfvm_50de9a28-23ac-4ab3-8f97-69390134d16e/kube-rbac-proxy/0.log" Jun 16 20:28:34.848124 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:34.848096 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvfvm_50de9a28-23ac-4ab3-8f97-69390134d16e/exporter/0.log" Jun 16 20:28:34.877028 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:34.877003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvfvm_50de9a28-23ac-4ab3-8f97-69390134d16e/extractor/0.log" Jun 16 20:28:35.918823 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:35.918798 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-tqlq7/perf-node-gather-daemonset-46wdx" Jun 16 20:28:37.754628 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:37.754593 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-55b496454d-mxjvz_054a8262-da4e-4a61-a2f1-a23ca0ee7686/manager/0.log" Jun 16 20:28:37.878727 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:37.878672 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-4dphv_8dd29b7d-4ca7-4275-8653-16a54cf60f3f/manager/0.log" Jun 16 20:28:37.944683 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:37.944652 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5cbd84db66-4dphv_8dd29b7d-4ca7-4275-8653-16a54cf60f3f/copy-manifests/0.log" Jun 16 20:28:39.947126 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:39.947097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7ff6468978-7mxks_20e6914e-bc79-4117-9a56-4e11e3228866/manager/0.log" Jun 16 20:28:42.018292 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:42.018263 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-6tskx_2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf/kube-auth-proxy/0.log" Jun 16 20:28:43.409823 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:43.409793 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-6tskx_2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf/kube-auth-proxy/0.log" Jun 16 20:28:45.572535 ip-10-0-139-232 kubenswrapper[2576]: I0616 20:28:45.572499 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-58ff4d787-6tskx_2929cbe6-b0b9-4457-ba4c-09ff48d9b6cf/kube-auth-proxy/0.log"