Jun 09 04:18:58.313476 ip-10-0-135-201 systemd[1]: Starting Kubernetes Kubelet... Jun 09 04:18:58.714343 ip-10-0-135-201 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 04:18:58.714343 ip-10-0-135-201 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 04:18:58.714343 ip-10-0-135-201 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 04:18:58.714343 ip-10-0-135-201 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 04:18:58.714343 ip-10-0-135-201 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 04:18:58.715430 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.715297 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 04:18:58.719792 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719775 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.719792 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719791 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719795 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719799 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719802 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719805 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719808 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719810 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719813 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719816 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719819 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719829 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719832 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719836 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719841 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719845 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719849 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719852 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719855 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719857 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.719868 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719860 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719863 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719865 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719868 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719871 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719874 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719877 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719879 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719882 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719885 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719887 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719890 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719892 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719895 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719897 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719900 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719902 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719904 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719907 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719910 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.720381 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719913 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719916 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719918 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719921 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719923 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719926 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719928 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719930 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719933 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719935 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719937 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719940 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719942 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719944 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719947 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719950 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719953 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719955 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719957 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719960 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.720898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719962 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719965 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719967 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719970 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719972 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719974 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719977 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719979 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719982 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719984 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719987 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719990 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719992 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719994 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719997 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.719999 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720002 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720004 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720006 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720008 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.721457 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720011 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720013 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720016 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720018 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720021 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720023 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720027 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720031 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720035 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720038 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720041 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720044 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720046 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720049 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720051 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720054 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720056 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720058 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.721967 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.720061 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722279 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722287 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722290 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722293 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722296 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722299 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722301 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722306 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722310 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722313 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722315 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722318 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722321 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722324 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722327 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722329 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722332 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722334 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722337 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.722485 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722340 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722342 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722344 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722347 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722349 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722352 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722354 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722357 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722359 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722362 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722364 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722367 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722369 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722372 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722376 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722386 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722391 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722393 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722396 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.723007 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722399 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722404 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722407 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722410 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722413 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722417 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722420 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722423 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722426 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722429 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722431 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722434 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722437 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722439 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722442 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722444 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722447 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722449 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722452 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.723572 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722454 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722457 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722459 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722461 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722464 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722466 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722469 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722471 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722474 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722477 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722480 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722482 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722485 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722487 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722491 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722493 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722496 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722499 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722502 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722505 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.724061 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722508 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722510 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722513 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722515 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722518 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722520 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722523 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722525 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722528 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722530 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722532 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722535 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722537 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722540 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722543 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722545 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722547 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722550 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722552 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722555 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.724599 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722558 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722561 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722910 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722915 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722918 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722921 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722924 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722927 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722929 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722932 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722934 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722937 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722939 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722943 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722946 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722950 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722953 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722956 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722959 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.725112 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722962 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722964 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722967 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722970 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722973 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722975 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722977 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722980 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722982 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722985 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722987 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722990 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722992 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722995 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.722997 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723000 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723002 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723005 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723007 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723010 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.725628 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723013 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723016 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723018 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723021 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723023 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723026 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723028 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723031 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723033 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723037 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723039 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723042 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723046 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723049 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723052 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723054 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723057 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723060 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723063 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723065 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.726159 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723068 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723070 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723073 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723075 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723078 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723081 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723084 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723086 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723089 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723091 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723093 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723096 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723098 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723101 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723104 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723106 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723108 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723111 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723113 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723116 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.726684 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723118 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723121 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723124 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723144 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723147 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723150 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723152 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723155 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723158 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723160 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723163 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723165 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723168 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723170 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723172 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723175 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723179 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723182 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723185 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723188 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.727263 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723191 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723194 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723257 2568 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723264 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723269 2568 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723273 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723278 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723281 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723285 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723289 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723292 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723295 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723298 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723301 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723304 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723307 2568 flags.go:64] FLAG: --cgroup-root="" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723310 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723313 2568 flags.go:64] FLAG: --client-ca-file="" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723316 2568 flags.go:64] FLAG: --cloud-provider="external" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723319 2568 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723323 2568 flags.go:64] FLAG: --cluster-domain="" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723326 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723329 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723332 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 04:18:58.727784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723335 2568 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723339 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723342 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723345 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723348 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723351 2568 flags.go:64] FLAG: --contention-profiling="false" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723353 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723356 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723359 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723362 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723366 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723369 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723371 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723379 2568 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723382 2568 flags.go:64] FLAG: --enable-server="true" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723386 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723390 2568 flags.go:64] FLAG: --event-burst="100" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723393 2568 flags.go:64] FLAG: --event-qps="50" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723396 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723399 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723401 2568 flags.go:64] FLAG: --eviction-hard="" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723405 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723408 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723411 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723413 2568 flags.go:64] FLAG: --eviction-soft="" Jun 09 04:18:58.728442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723416 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723419 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723421 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723424 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723427 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723429 2568 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723432 2568 flags.go:64] FLAG: --feature-gates="" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723436 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723438 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723441 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723444 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723447 2568 flags.go:64] FLAG: --healthz-port="10248" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723450 2568 flags.go:64] FLAG: --help="false" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723452 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723455 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723458 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723461 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723464 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723467 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723470 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723474 2568 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723477 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723479 2568 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 04:18:58.729076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723483 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723486 2568 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723489 2568 flags.go:64] FLAG: --kube-reserved="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723491 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723494 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723497 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723500 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723502 2568 flags.go:64] FLAG: --lock-file="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723505 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723508 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723511 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723516 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723518 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723521 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723523 2568 flags.go:64] FLAG: --logging-format="text" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723526 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723530 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723532 2568 flags.go:64] FLAG: --manifest-url="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723535 2568 flags.go:64] FLAG: --manifest-url-header="" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723539 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723542 2568 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723549 2568 flags.go:64] FLAG: --max-pods="110" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723552 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723555 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723558 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 04:18:58.729697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723561 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723564 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723567 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723570 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723577 2568 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723580 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723583 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723587 2568 flags.go:64] FLAG: --pod-cidr="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723590 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723596 2568 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723599 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723602 2568 flags.go:64] FLAG: --pods-per-core="0" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723605 2568 flags.go:64] FLAG: --port="10250" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723608 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723610 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0858b9b3f86e62320" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723613 2568 flags.go:64] FLAG: --qos-reserved="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723616 2568 flags.go:64] FLAG: --read-only-port="10255" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723619 2568 flags.go:64] FLAG: --register-node="true" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723622 2568 flags.go:64] FLAG: --register-with-taints="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723625 2568 flags.go:64] FLAG: --registry-burst="10" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723628 2568 flags.go:64] FLAG: --registry-qps="5" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723630 2568 flags.go:64] FLAG: --reserved-cpus="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723633 2568 flags.go:64] FLAG: --reserved-memory="" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723636 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723642 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 04:18:58.730369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723645 2568 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723648 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723651 2568 flags.go:64] FLAG: --runonce="false" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723654 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723657 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723659 2568 flags.go:64] FLAG: --seccomp-default="false" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723662 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723665 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723667 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723670 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723674 2568 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723677 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723680 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723683 2568 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723685 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723689 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723692 2568 flags.go:64] FLAG: --system-cgroups="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723694 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723700 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723702 2568 flags.go:64] FLAG: --tls-cert-file="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723705 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723709 2568 flags.go:64] FLAG: --tls-min-version="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723712 2568 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723715 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723717 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 04:18:58.731064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723720 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723722 2568 flags.go:64] FLAG: --v="2" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723726 2568 flags.go:64] FLAG: --version="false" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723730 2568 flags.go:64] FLAG: --vmodule="" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723733 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.723736 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723852 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723856 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723859 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723861 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723864 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723866 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723869 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723871 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723874 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723876 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723879 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723882 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723887 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723890 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723893 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.731739 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723895 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723898 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723901 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723904 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723907 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723910 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723913 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723915 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723917 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723920 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723922 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723924 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723927 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723929 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723932 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723934 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723937 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723941 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723944 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723946 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.732372 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723948 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723951 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723954 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723956 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723959 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723961 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723964 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723966 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723969 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723973 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723976 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723978 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723980 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723983 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723985 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723988 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723991 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723993 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723995 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.723998 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.732889 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724000 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724003 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724005 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724007 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724010 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724012 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724015 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724017 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724020 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724024 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724026 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724029 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724031 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724034 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724036 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724039 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724041 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724044 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724046 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724048 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.733428 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724051 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724054 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724057 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724060 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724062 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724066 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724069 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724072 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724075 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724078 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724080 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724082 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724085 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724087 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724090 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724092 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724094 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724097 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724100 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.733953 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724104 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724106 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724111 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724113 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.724116 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.724121 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.731981 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.731995 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.732007 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.732012 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732067 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732072 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732075 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732078 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732081 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.734625 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732084 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732087 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732089 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732092 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732094 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732097 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732099 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732102 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732104 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732108 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732111 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732113 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732116 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732118 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732121 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732123 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732126 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732146 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732150 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732154 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.735236 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732157 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732159 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732162 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732165 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732168 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732171 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732173 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732177 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732181 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732184 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732187 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732190 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732193 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732196 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732199 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732202 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732205 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732208 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732210 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.735765 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732213 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732216 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732218 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732221 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732223 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732226 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732228 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732231 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732233 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732236 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732239 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732242 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732245 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732248 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732251 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732254 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732256 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732258 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732262 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732264 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.736334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732267 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732269 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732272 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732275 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732278 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732280 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732283 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732285 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732287 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732290 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732292 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732295 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732297 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732300 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732302 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732304 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732307 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732310 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732312 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.736931 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732314 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732317 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732319 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732322 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732325 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732327 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732330 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732332 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732335 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732337 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732340 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732342 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732345 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732348 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732350 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.737480 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732352 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.732357 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732484 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732489 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732492 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732495 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732498 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732501 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732504 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732506 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732509 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732511 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732514 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732516 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732519 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 04:18:58.737869 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732521 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732523 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732526 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732528 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732531 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732534 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732537 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732539 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732542 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732544 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732547 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732550 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732552 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732554 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732557 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732560 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732562 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732564 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732567 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 04:18:58.738288 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732569 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732572 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732574 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732576 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732579 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732581 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732584 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732586 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732589 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732591 2568 feature_gate.go:328] unrecognized feature gate: Example Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732593 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732596 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732600 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732603 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732606 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732609 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732611 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732614 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732617 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732620 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 04:18:58.738781 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732622 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732624 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732627 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732629 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732632 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732634 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732636 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732639 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732642 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732646 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732649 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732651 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732654 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732657 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732659 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732662 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732664 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732667 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732669 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732671 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 04:18:58.739301 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732674 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732676 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732679 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732681 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732684 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732686 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732689 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732691 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732694 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732696 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732699 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732701 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732704 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732706 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732709 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732711 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732713 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732716 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732718 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732721 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 04:18:58.739807 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732724 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732727 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732730 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732732 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732734 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732737 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:58.732739 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.732744 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.732837 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.736291 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.738160 2568 server.go:1019] "Starting client certificate rotation" Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.738255 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 04:18:58.740384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.738289 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 04:18:58.742246 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.742230 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 04:18:58.743621 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.743596 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 04:18:58.758469 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.758418 2568 log.go:25] "Validated CRI v1 runtime API" Jun 09 04:18:58.760837 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.760820 2568 log.go:25] "Validated CRI v1 image API" Jun 09 04:18:58.761698 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.761681 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 04:18:58.764395 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.764377 2568 fs.go:135] Filesystem UUIDs: map[32210abd-4734-44c3-9279-800211506071:/dev/nvme0n1p3 76b4b176-b1c7-4d24-9e9c-31910dcee9a3:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 09 04:18:58.764476 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.764395 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 04:18:58.767189 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.767171 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 04:18:58.769622 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.769507 2568 manager.go:216] Machine: {Timestamp:2026-06-09 04:18:58.768412479 +0000 UTC m=+0.335123490 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3087128 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2eb27310f2ba511b3171cfc6086a89 SystemUUID:ec2eb273-10f2-ba51-1b31-71cfc6086a89 BootID:fbc5332a-313e-4268-80de-10b755625e71 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:e6:6b:91:03 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:e6:6b:91:03 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:56:50:3e:e3:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 04:18:58.769622 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.769614 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 04:18:58.769731 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.769690 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 04:18:58.770696 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.770666 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 04:18:58.770874 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.770706 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-201.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 04:18:58.771394 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.771383 2568 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 04:18:58.771447 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.771402 2568 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 04:18:58.771447 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.771412 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 04:18:58.771967 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.771956 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 04:18:58.772691 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.772680 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 04:18:58.775171 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775156 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 09 04:18:58.775466 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775453 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 04:18:58.775530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775504 2568 kubelet.go:486] "Attempting to sync node with API server" Jun 09 04:18:58.775530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775518 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 04:18:58.775628 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775536 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 04:18:58.775628 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775549 2568 kubelet.go:398] "Adding apiserver pod source" Jun 09 04:18:58.775628 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775573 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 04:18:58.775938 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775924 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 04:18:58.776003 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.775955 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 04:18:58.778931 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.778914 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 04:18:58.784624 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.784596 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 04:18:58.784702 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.784647 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 04:18:58.784998 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.784966 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 04:18:58.785098 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.785072 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-201.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 04:18:58.790797 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.790782 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 04:18:58.790875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.790804 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 04:18:58.790875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.790814 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 04:18:58.790875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.790822 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 04:18:58.790988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.790815 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9lwl" Jun 09 04:18:58.791089 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791063 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 04:18:58.791145 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791103 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 04:18:58.791145 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791120 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 04:18:58.791208 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791145 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 04:18:58.791208 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791157 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 04:18:58.791208 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791167 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 04:18:58.791208 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791178 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 04:18:58.791208 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791186 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 04:18:58.791846 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791835 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 04:18:58.791878 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.791848 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 04:18:58.793406 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.793391 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-201.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 04:18:58.794843 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.794829 2568 server.go:1268] "Started kubelet" Jun 09 04:18:58.794910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.794888 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 04:18:58.794961 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.794911 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 04:18:58.795005 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.794982 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 04:18:58.795748 ip-10-0-135-201 systemd[1]: Started Kubernetes Kubelet. Jun 09 04:18:58.796459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.796430 2568 server.go:310] "Adding debug handlers to kubelet server" Jun 09 04:18:58.796459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.796450 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-g9lwl" Jun 09 04:18:58.796851 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.796836 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 04:18:58.801461 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.801442 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 04:18:58.801537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.801505 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 04:18:58.801537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.801525 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 04:18:58.801638 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.801601 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:58.802176 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802156 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 04:18:58.802176 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802178 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 04:18:58.802301 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802255 2568 factory.go:55] Registering systemd factory Jun 09 04:18:58.802301 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802273 2568 factory.go:223] Registration of the systemd container factory successfully Jun 09 04:18:58.802401 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802307 2568 reconstruct.go:97] "Volume reconstruction finished" Jun 09 04:18:58.802401 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802315 2568 reconciler.go:29] "Reconciler: start to sync state" Jun 09 04:18:58.802401 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802322 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 04:18:58.802542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802447 2568 factory.go:153] Registering CRI-O factory Jun 09 04:18:58.802542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802454 2568 factory.go:223] Registration of the crio container factory successfully Jun 09 04:18:58.802542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802496 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 04:18:58.802542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802518 2568 factory.go:103] Registering Raw factory Jun 09 04:18:58.802542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802530 2568 manager.go:1196] Started watching for new ooms in manager Jun 09 04:18:58.802938 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.802923 2568 manager.go:349] Starting recovery of all containers Jun 09 04:18:58.808475 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.808458 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:18:58.811297 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.811112 2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-135-201.ec2.internal\" not found" node="ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.814915 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.814897 2568 manager.go:354] Recovery completed Jun 09 04:18:58.821824 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.821810 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.823452 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.823425 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.823534 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.823458 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.823534 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.823473 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.824192 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824177 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 04:18:58.824192 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824191 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.824327 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824191 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 04:18:58.824327 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824262 2568 state_mem.go:36] "Initialized new in-memory state store" Jun 09 04:18:58.824915 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824901 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.824990 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824924 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.824990 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.824934 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.825356 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.825342 2568 policy_none.go:49] "None policy: Start" Jun 09 04:18:58.825356 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.825358 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 04:18:58.825478 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.825368 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 04:18:58.826354 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.826342 2568 policy_none.go:47] "Start" Jun 09 04:18:58.865816 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.865797 2568 manager.go:337] "Starting Device Plugin manager" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.865829 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.865841 2568 server.go:87] "Starting device plugin registration server" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.866091 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.866102 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.866245 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.866339 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 04:18:58.867195 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.866347 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 04:18:58.867564 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.867206 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 04:18:58.867564 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.867266 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:58.868025 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.868001 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 04:18:58.869377 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.869350 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 04:18:58.869469 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.869401 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 04:18:58.869469 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.869423 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 04:18:58.869469 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.869462 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 04:18:58.871473 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.871452 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:18:58.967229 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.967201 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.968165 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.968150 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.968243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.968185 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.968243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.968200 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.968243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.968229 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.970299 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.970283 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal"] Jun 09 04:18:58.970364 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.970335 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.971590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.971576 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.971676 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.971605 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.971676 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.971618 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.972708 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.972693 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.972824 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.972810 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.972874 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.972838 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.973404 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973388 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.973465 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973421 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.973465 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973438 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.973537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973392 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.973537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973489 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.973537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.973498 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.974565 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.974549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.974648 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.974574 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 04:18:58.975184 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.975169 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientMemory" Jun 09 04:18:58.975260 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.975196 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 04:18:58.975260 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.975212 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeHasSufficientPID" Jun 09 04:18:58.976916 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:58.976900 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.977000 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.976919 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-201.ec2.internal\": node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:58.990670 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.990652 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-201.ec2.internal\" not found" node="ip-10-0-135-201.ec2.internal" Jun 09 04:18:58.993150 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.993119 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:58.994044 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:58.994032 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-201.ec2.internal\" not found" node="ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.093502 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.093458 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.104234 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.104213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.104306 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.104251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.104306 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.104279 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cafe6f486dffca6906cacfbb14ec640b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"cafe6f486dffca6906cacfbb14ec640b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.194163 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.194143 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.204483 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cafe6f486dffca6906cacfbb14ec640b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"cafe6f486dffca6906cacfbb14ec640b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.204533 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.204582 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.204582 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.204663 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204574 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/cafe6f486dffca6906cacfbb14ec640b-config\") pod \"kube-apiserver-proxy-ip-10-0-135-201.ec2.internal\" (UID: \"cafe6f486dffca6906cacfbb14ec640b\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.204663 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.204598 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/949d526c973c0d4a7c08f951eda71f22-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal\" (UID: \"949d526c973c0d4a7c08f951eda71f22\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.294908 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.294885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.295027 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.294886 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.299262 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.299238 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:18:59.395867 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.395815 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.496373 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.496348 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.596820 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.596790 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.697442 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.697415 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.736865 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.736841 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 04:18:59.737450 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.736981 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 04:18:59.737450 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.737017 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 04:18:59.767787 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:59.767760 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcafe6f486dffca6906cacfbb14ec640b.slice/crio-0d6aedbc23b19b10a21db7a67b3e19ab2b5a9ceda101901eddd6ee0d66c6be72 WatchSource:0}: Error finding container 0d6aedbc23b19b10a21db7a67b3e19ab2b5a9ceda101901eddd6ee0d66c6be72: Status 404 returned error can't find the container with id 0d6aedbc23b19b10a21db7a67b3e19ab2b5a9ceda101901eddd6ee0d66c6be72 Jun 09 04:18:59.768063 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:18:59.768044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949d526c973c0d4a7c08f951eda71f22.slice/crio-8b3987236121a3cc33c1d919a84262fa99a1b3ec0b8dfd935eb13006cf184e8b WatchSource:0}: Error finding container 8b3987236121a3cc33c1d919a84262fa99a1b3ec0b8dfd935eb13006cf184e8b: Status 404 returned error can't find the container with id 8b3987236121a3cc33c1d919a84262fa99a1b3ec0b8dfd935eb13006cf184e8b Jun 09 04:18:59.773647 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.773631 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 04:18:59.798403 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.798365 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.800586 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.800562 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 04:13:58 +0000 UTC" deadline="2027-12-08 19:16:18.693770623 +0000 UTC" Jun 09 04:18:59.800650 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.800587 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13142h57m18.893187743s" Jun 09 04:18:59.872689 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.872641 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" event={"ID":"cafe6f486dffca6906cacfbb14ec640b","Type":"ContainerStarted","Data":"0d6aedbc23b19b10a21db7a67b3e19ab2b5a9ceda101901eddd6ee0d66c6be72"} Jun 09 04:18:59.873657 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.873632 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"949d526c973c0d4a7c08f951eda71f22","Type":"ContainerStarted","Data":"8b3987236121a3cc33c1d919a84262fa99a1b3ec0b8dfd935eb13006cf184e8b"} Jun 09 04:18:59.898802 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:18:59.898771 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-201.ec2.internal\" not found" Jun 09 04:18:59.981595 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:18:59.981553 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:19:00.002363 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.002343 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" Jun 09 04:19:00.011518 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.011490 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 04:19:00.013291 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.013280 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" Jun 09 04:19:00.021695 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.021678 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 04:19:00.158116 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.158097 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:19:00.579093 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.579063 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:19:00.775945 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.775908 2568 apiserver.go:52] "Watching apiserver" Jun 09 04:19:00.782872 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.782850 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 04:19:00.783831 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.783803 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-g2rkj","openshift-network-diagnostics/network-check-target-hb5dm","kube-system/global-pull-secret-syncer-bpb6w","kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal","openshift-dns/node-resolver-hp78k","openshift-image-registry/node-ca-rqwmp","openshift-multus/network-metrics-daemon-drz8k","openshift-network-operator/iptables-alerter-29djf","openshift-ovn-kubernetes/ovnkube-node-82vrh","kube-system/konnectivity-agent-mnh49","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg","openshift-cluster-node-tuning-operator/tuned-lshz7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal","openshift-multus/multus-additional-cni-plugins-r7cbb"] Jun 09 04:19:00.785792 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.785770 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.787289 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.787261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:00.787386 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.787335 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:00.788988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.788682 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.788988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.788773 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 04:19:00.788988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.788797 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hnlsr\"" Jun 09 04:19:00.788988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.788860 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.789236 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.789064 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 04:19:00.789236 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.789080 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.789236 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.789218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 04:19:00.789358 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.789287 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 04:19:00.790231 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.790200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.790542 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.790518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 04:19:00.791064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.791048 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 04:19:00.791258 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.791243 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l66n5\"" Jun 09 04:19:00.792092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.792061 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.792092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.792079 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.792092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.792079 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qlv6m\"" Jun 09 04:19:00.792461 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.792428 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.794305 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.794288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.794305 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.794302 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.794458 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.794302 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 04:19:00.794458 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.794352 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:00.794546 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.794533 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.794601 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.794574 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gxrs5\"" Jun 09 04:19:00.795738 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.795721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.797464 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.797622 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.797654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.797715 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.797778 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dm5m4\"" Jun 09 04:19:00.797817 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.797813 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 04:19:00.799689 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.799663 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.801752 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.801691 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.801831 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.801802 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 04:19:00.801919 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.801893 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.802025 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.802003 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-r6s7w\"" Jun 09 04:19:00.802025 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.802020 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 04:19:00.802169 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.802065 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 04:19:00.802232 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.802218 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.803798 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.803781 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.804081 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.804028 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 04:19:00.804335 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.804316 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fq49t\"" Jun 09 04:19:00.804427 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.804375 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.804427 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.804322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.805560 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.805541 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 04:19:00.805851 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.805834 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j4nmq\"" Jun 09 04:19:00.806258 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.806212 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.806360 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.806343 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 04:19:00.808204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.808186 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 04:19:00.808291 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.808252 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wzbv6\"" Jun 09 04:19:00.808444 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.808430 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 04:19:00.811977 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.810354 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 04:19:00.812743 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.812722 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 04:19:00.814016 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.813988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.814110 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.814110 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814102 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-kubelet-config\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.814246 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-multus\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.814319 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-etc-kubernetes\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.814319 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814293 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-registration-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-sys-fs\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814353 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-conf\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-systemd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73689180-35c0-4259-b343-6a0116039fff-serviceca\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814448 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.814487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-kubelet\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-lib-modules\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814537 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-config\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814562 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99b1ae0a-1808-4b58-914f-c8d16b928399-ovn-node-metrics-cert\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57krt\" (UniqueName: \"kubernetes.io/projected/ed958935-96d6-4907-a9e5-34baea7692ca-kube-api-access-57krt\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-iptables-alerter-script\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-socket-dir-parent\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.814763 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed958935-96d6-4907-a9e5-34baea7692ca-tmp-dir\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-cni-binary-copy\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-tmp\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-log-socket\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-hostroot\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-daemon-config\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.815150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-multus-certs\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.815467 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.814969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.815520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815472 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-var-lib-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.815654 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.815728 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-run\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.815728 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-kubelet\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.815828 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn44z\" (UniqueName: \"kubernetes.io/projected/99b1ae0a-1808-4b58-914f-c8d16b928399-kube-api-access-xn44z\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.815828 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9661392c-e0aa-48fa-8bc2-906c1ac58200-konnectivity-ca\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.815933 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmkvh\" (UniqueName: \"kubernetes.io/projected/73689180-35c0-4259-b343-6a0116039fff-kube-api-access-rmkvh\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.815933 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815899 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-netns\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.816025 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.815954 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-socket-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.816074 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-netns\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.816621 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9661392c-e0aa-48fa-8bc2-906c1ac58200-agent-certs\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.816697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-conf-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.816697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-host\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.816697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-k8s-cni-cncf-io\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816748 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-systemd\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-sys\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816791 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd9xj\" (UniqueName: \"kubernetes.io/projected/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-kube-api-access-pd9xj\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-system-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-os-release\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-device-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.816890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816886 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-modprobe-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-tuned\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.816954 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed958935-96d6-4907-a9e5-34baea7692ca-hosts-file\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-host-slash\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817053 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73689180-35c0-4259-b343-6a0116039fff-host\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817085 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-dbus\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-kubernetes\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-var-lib-kubelet\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817200 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmt6f\" (UniqueName: \"kubernetes.io/projected/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-kube-api-access-lmt6f\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-ovn\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrrbc\" (UniqueName: \"kubernetes.io/projected/e554b371-885b-45ed-973a-0a62cc7d6bad-kube-api-access-zrrbc\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysconfig\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-systemd-units\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-etc-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-node-log\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-env-overrides\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-script-lib\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817461 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-cnibin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817505 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-bin\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-bin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4xfb\" (UniqueName: \"kubernetes.io/projected/c6483c48-cbc4-416f-9cf2-2707a7676302-kube-api-access-g4xfb\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-slash\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-netd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.817885 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.817682 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgt54\" (UniqueName: \"kubernetes.io/projected/f4a913c5-8e81-4375-9119-f94141550ecf-kube-api-access-jgt54\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.830411 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.830386 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gbm4" Jun 09 04:19:00.837021 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.836999 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5gbm4" Jun 09 04:19:00.903253 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.903225 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 04:19:00.918110 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-k8s-cni-cncf-io\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-systemd\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918180 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-sys\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd9xj\" (UniqueName: \"kubernetes.io/projected/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-kube-api-access-pd9xj\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-k8s-cni-cncf-io\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-system-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918247 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-os-release\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918266 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-systemd\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-device-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-system-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918318 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-modprobe-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918344 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-os-release\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918347 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-tuned\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918392 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-device-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed958935-96d6-4907-a9e5-34baea7692ca-hosts-file\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918449 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed958935-96d6-4907-a9e5-34baea7692ca-hosts-file\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-modprobe-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-host-slash\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918552 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73689180-35c0-4259-b343-6a0116039fff-host\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-host-slash\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-dbus\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.918616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-kubernetes\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918666 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-kubernetes\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/73689180-35c0-4259-b343-6a0116039fff-host\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918677 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-dbus\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-var-lib-kubelet\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918729 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-sys\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-var-lib-kubelet\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918668 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmt6f\" (UniqueName: \"kubernetes.io/projected/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-kube-api-access-lmt6f\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918805 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-ovn\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrrbc\" (UniqueName: \"kubernetes.io/projected/e554b371-885b-45ed-973a-0a62cc7d6bad-kube-api-access-zrrbc\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918859 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-ovn\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918875 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysconfig\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-systemd-units\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918932 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysconfig\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-etc-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918969 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-node-log\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918984 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-systemd-units\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.919311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.918990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-env-overrides\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-script-lib\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919044 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-etc-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919055 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-cnibin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-node-log\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-bin\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919198 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-cnibin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-bin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4xfb\" (UniqueName: \"kubernetes.io/projected/c6483c48-cbc4-416f-9cf2-2707a7676302-kube-api-access-g4xfb\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919255 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-bin\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-slash\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-netd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919321 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-system-cni-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgt54\" (UniqueName: \"kubernetes.io/projected/f4a913c5-8e81-4375-9119-f94141550ecf-kube-api-access-jgt54\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.920196 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919419 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-slash\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-kubelet-config\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-bin\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-env-overrides\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-multus\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-cni-netd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919499 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-etc-kubernetes\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919527 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-etc-selinux\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919553 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-etc-kubernetes\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919554 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/11da152c-7e1f-41a8-9545-e661f523b5ce-kubelet-config\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919582 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-cni-multus\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919612 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-d\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-registration-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.919659 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919726 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-script-lib\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.921036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919741 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-registration-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.919771 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:01.419751607 +0000 UTC m=+2.986462646 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-sys-fs\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919850 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-sys-fs\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919889 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-conf\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919912 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-systemd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919948 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-systemd\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.919966 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73689180-35c0-4259-b343-6a0116039fff-serviceca\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-sysctl-conf\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920046 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-kubelet\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920070 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-lib-modules\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.920091 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920096 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-config\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99b1ae0a-1808-4b58-914f-c8d16b928399-ovn-node-metrics-cert\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.920159 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:01.420124549 +0000 UTC m=+2.986835551 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:00.922121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920188 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-cnibin\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57krt\" (UniqueName: \"kubernetes.io/projected/ed958935-96d6-4907-a9e5-34baea7692ca-kube-api-access-57krt\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-iptables-alerter-script\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-socket-dir-parent\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920287 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-lib-modules\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920323 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed958935-96d6-4907-a9e5-34baea7692ca-tmp-dir\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920389 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-cni-binary-copy\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-tmp\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920427 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/73689180-35c0-4259-b343-6a0116039fff-serviceca\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-log-socket\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-socket-dir-parent\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920513 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-hostroot\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920157 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-var-lib-kubelet\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920613 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/99b1ae0a-1808-4b58-914f-c8d16b928399-ovnkube-config\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.922986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed958935-96d6-4907-a9e5-34baea7692ca-tmp-dir\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.920977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-log-socket\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-hostroot\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-daemon-config\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-multus-certs\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921149 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-var-lib-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921217 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-run\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-kubelet\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921271 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-iptables-alerter-script\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn44z\" (UniqueName: \"kubernetes.io/projected/99b1ae0a-1808-4b58-914f-c8d16b928399-kube-api-access-xn44z\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921331 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9661392c-e0aa-48fa-8bc2-906c1ac58200-konnectivity-ca\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-cni-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921421 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-var-lib-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921447 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmkvh\" (UniqueName: \"kubernetes.io/projected/73689180-35c0-4259-b343-6a0116039fff-kube-api-access-rmkvh\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921543 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-netns\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.923682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-socket-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921616 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-netns\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921644 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-os-release\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwjmg\" (UniqueName: \"kubernetes.io/projected/de9a4011-c351-490b-bfc2-4d8310d916a4-kube-api-access-hwjmg\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921766 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9661392c-e0aa-48fa-8bc2-906c1ac58200-agent-certs\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-conf-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-host\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921863 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-cni-binary-copy\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921939 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-daemon-config\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.921998 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922034 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-host\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922113 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c6483c48-cbc4-416f-9cf2-2707a7676302-socket-dir\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922182 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-run-netns\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922495 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9661392c-e0aa-48fa-8bc2-906c1ac58200-konnectivity-ca\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922723 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-multus-certs\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922778 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-run-openvswitch\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.924286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922815 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-host-run-netns\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922853 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922893 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/99b1ae0a-1808-4b58-914f-c8d16b928399-host-kubelet\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922956 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-run\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.922997 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e554b371-885b-45ed-973a-0a62cc7d6bad-multus-conf-dir\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.923280 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-etc-tuned\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.923320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-tmp\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.923590 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/99b1ae0a-1808-4b58-914f-c8d16b928399-ovn-node-metrics-cert\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:00.925023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.924889 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9661392c-e0aa-48fa-8bc2-906c1ac58200-agent-certs\") pod \"konnectivity-agent-mnh49\" (UID: \"9661392c-e0aa-48fa-8bc2-906c1ac58200\") " pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:00.926165 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.926144 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:00.926285 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.926169 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:00.926285 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.926184 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:00.926285 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:00.926243 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:01.426224419 +0000 UTC m=+2.992935435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:00.930590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.930325 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgt54\" (UniqueName: \"kubernetes.io/projected/f4a913c5-8e81-4375-9119-f94141550ecf-kube-api-access-jgt54\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:00.930590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.930372 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd9xj\" (UniqueName: \"kubernetes.io/projected/7f999be1-dcf7-47c5-a686-2be18f8e5c6a-kube-api-access-pd9xj\") pod \"iptables-alerter-29djf\" (UID: \"7f999be1-dcf7-47c5-a686-2be18f8e5c6a\") " pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:00.930590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.930409 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmt6f\" (UniqueName: \"kubernetes.io/projected/bb89ad4e-cb3c-4fe1-b35f-bbdb97014873-kube-api-access-lmt6f\") pod \"tuned-lshz7\" (UID: \"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873\") " pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:00.930590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.930467 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4xfb\" (UniqueName: \"kubernetes.io/projected/c6483c48-cbc4-416f-9cf2-2707a7676302-kube-api-access-g4xfb\") pod \"aws-ebs-csi-driver-node-b6wqg\" (UID: \"c6483c48-cbc4-416f-9cf2-2707a7676302\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:00.930590 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.930519 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57krt\" (UniqueName: \"kubernetes.io/projected/ed958935-96d6-4907-a9e5-34baea7692ca-kube-api-access-57krt\") pod \"node-resolver-hp78k\" (UID: \"ed958935-96d6-4907-a9e5-34baea7692ca\") " pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:00.931726 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.931284 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrrbc\" (UniqueName: \"kubernetes.io/projected/e554b371-885b-45ed-973a-0a62cc7d6bad-kube-api-access-zrrbc\") pod \"multus-g2rkj\" (UID: \"e554b371-885b-45ed-973a-0a62cc7d6bad\") " pod="openshift-multus/multus-g2rkj" Jun 09 04:19:00.931726 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.931660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmkvh\" (UniqueName: \"kubernetes.io/projected/73689180-35c0-4259-b343-6a0116039fff-kube-api-access-rmkvh\") pod \"node-ca-rqwmp\" (UID: \"73689180-35c0-4259-b343-6a0116039fff\") " pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:00.932031 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:00.932008 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn44z\" (UniqueName: \"kubernetes.io/projected/99b1ae0a-1808-4b58-914f-c8d16b928399-kube-api-access-xn44z\") pod \"ovnkube-node-82vrh\" (UID: \"99b1ae0a-1808-4b58-914f-c8d16b928399\") " pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:01.022454 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022407 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-os-release\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwjmg\" (UniqueName: \"kubernetes.io/projected/de9a4011-c351-490b-bfc2-4d8310d916a4-kube-api-access-hwjmg\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022539 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022567 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-os-release\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022905 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022905 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022726 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-system-cni-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022905 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022905 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-system-cni-dir\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.022905 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022837 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-cnibin\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.023087 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.022912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/de9a4011-c351-490b-bfc2-4d8310d916a4-cnibin\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.023122 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.023098 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-binary-copy\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.023186 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.023098 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.023227 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.023215 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/de9a4011-c351-490b-bfc2-4d8310d916a4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.030054 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.030026 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwjmg\" (UniqueName: \"kubernetes.io/projected/de9a4011-c351-490b-bfc2-4d8310d916a4-kube-api-access-hwjmg\") pod \"multus-additional-cni-plugins-r7cbb\" (UID: \"de9a4011-c351-490b-bfc2-4d8310d916a4\") " pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.098160 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.098059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:01.105183 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.105157 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:01.116665 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.116646 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hp78k" Jun 09 04:19:01.120058 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.120036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rqwmp" Jun 09 04:19:01.126539 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.126519 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-29djf" Jun 09 04:19:01.132989 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.132967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g2rkj" Jun 09 04:19:01.139693 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.139675 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" Jun 09 04:19:01.146098 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.146080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lshz7" Jun 09 04:19:01.151585 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.151569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" Jun 09 04:19:01.425359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.425283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:01.425359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.425333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:01.425511 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.425431 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:01.425511 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.425449 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:01.425511 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.425490 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:02.425474841 +0000 UTC m=+3.992185838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:01.425511 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.425504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:02.425497729 +0000 UTC m=+3.992208726 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:01.526619 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.526590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:01.526783 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.526765 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:01.526866 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.526790 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:01.526866 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.526803 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:01.526973 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:01.526866 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:02.526847192 +0000 UTC m=+4.093558190 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:01.764079 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.764053 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb89ad4e_cb3c_4fe1_b35f_bbdb97014873.slice/crio-d6561f6250b606b816f6b1bf257d925a7c1a8eec967e57e2d225f6ee7d8cc565 WatchSource:0}: Error finding container d6561f6250b606b816f6b1bf257d925a7c1a8eec967e57e2d225f6ee7d8cc565: Status 404 returned error can't find the container with id d6561f6250b606b816f6b1bf257d925a7c1a8eec967e57e2d225f6ee7d8cc565 Jun 09 04:19:01.765519 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.765490 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b1ae0a_1808_4b58_914f_c8d16b928399.slice/crio-7814a771f2401bfdffe488e8918d2170d37faae9d914de469e8d8276124bd360 WatchSource:0}: Error finding container 7814a771f2401bfdffe488e8918d2170d37faae9d914de469e8d8276124bd360: Status 404 returned error can't find the container with id 7814a771f2401bfdffe488e8918d2170d37faae9d914de469e8d8276124bd360 Jun 09 04:19:01.767098 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.767021 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73689180_35c0_4259_b343_6a0116039fff.slice/crio-eb91b1e280c1f7bbe172fd2eabb73888a2af9a6b312da639459986017435935d WatchSource:0}: Error finding container eb91b1e280c1f7bbe172fd2eabb73888a2af9a6b312da639459986017435935d: Status 404 returned error can't find the container with id eb91b1e280c1f7bbe172fd2eabb73888a2af9a6b312da639459986017435935d Jun 09 04:19:01.769035 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.769009 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6483c48_cbc4_416f_9cf2_2707a7676302.slice/crio-78dd475d38758688870fa415943ce0078afcaabfa229bf5668e451d0852c2ad5 WatchSource:0}: Error finding container 78dd475d38758688870fa415943ce0078afcaabfa229bf5668e451d0852c2ad5: Status 404 returned error can't find the container with id 78dd475d38758688870fa415943ce0078afcaabfa229bf5668e451d0852c2ad5 Jun 09 04:19:01.791427 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.791401 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f999be1_dcf7_47c5_a686_2be18f8e5c6a.slice/crio-3f6820d67845c91a3e9987eb26134d8673bc7f52df6c9ba8b504367d42a66c3b WatchSource:0}: Error finding container 3f6820d67845c91a3e9987eb26134d8673bc7f52df6c9ba8b504367d42a66c3b: Status 404 returned error can't find the container with id 3f6820d67845c91a3e9987eb26134d8673bc7f52df6c9ba8b504367d42a66c3b Jun 09 04:19:01.792713 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.792691 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded958935_96d6_4907_a9e5_34baea7692ca.slice/crio-7077f69c92acf01f52174f1349ad80b3a66fa0f125c9b76c96f50fe1db551b7e WatchSource:0}: Error finding container 7077f69c92acf01f52174f1349ad80b3a66fa0f125c9b76c96f50fe1db551b7e: Status 404 returned error can't find the container with id 7077f69c92acf01f52174f1349ad80b3a66fa0f125c9b76c96f50fe1db551b7e Jun 09 04:19:01.793330 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.793311 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9661392c_e0aa_48fa_8bc2_906c1ac58200.slice/crio-718ddd2596b77eecf4c531c7a1e31cdc5cc78a14aedcf3944778e4b5051f927c WatchSource:0}: Error finding container 718ddd2596b77eecf4c531c7a1e31cdc5cc78a14aedcf3944778e4b5051f927c: Status 404 returned error can't find the container with id 718ddd2596b77eecf4c531c7a1e31cdc5cc78a14aedcf3944778e4b5051f927c Jun 09 04:19:01.794105 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.794087 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode554b371_885b_45ed_973a_0a62cc7d6bad.slice/crio-b00fc008fe7bcfdfb58e5be6590f40dd04bc7df476643b3d72563fae84d6f658 WatchSource:0}: Error finding container b00fc008fe7bcfdfb58e5be6590f40dd04bc7df476643b3d72563fae84d6f658: Status 404 returned error can't find the container with id b00fc008fe7bcfdfb58e5be6590f40dd04bc7df476643b3d72563fae84d6f658 Jun 09 04:19:01.794783 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:01.794761 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde9a4011_c351_490b_bfc2_4d8310d916a4.slice/crio-63f0ea419e59f5707eebfc89702a2103936147068101d1d282b86da333e4e986 WatchSource:0}: Error finding container 63f0ea419e59f5707eebfc89702a2103936147068101d1d282b86da333e4e986: Status 404 returned error can't find the container with id 63f0ea419e59f5707eebfc89702a2103936147068101d1d282b86da333e4e986 Jun 09 04:19:01.839960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.839809 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 04:14:00 +0000 UTC" deadline="2027-11-15 05:15:25.567110935 +0000 UTC" Jun 09 04:19:01.839960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.839958 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12576h56m23.727157067s" Jun 09 04:19:01.878956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.878931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"7814a771f2401bfdffe488e8918d2170d37faae9d914de469e8d8276124bd360"} Jun 09 04:19:01.880259 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.880233 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lshz7" event={"ID":"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873","Type":"ContainerStarted","Data":"d6561f6250b606b816f6b1bf257d925a7c1a8eec967e57e2d225f6ee7d8cc565"} Jun 09 04:19:01.881316 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.881289 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g2rkj" event={"ID":"e554b371-885b-45ed-973a-0a62cc7d6bad","Type":"ContainerStarted","Data":"b00fc008fe7bcfdfb58e5be6590f40dd04bc7df476643b3d72563fae84d6f658"} Jun 09 04:19:01.882238 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.882215 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" event={"ID":"c6483c48-cbc4-416f-9cf2-2707a7676302","Type":"ContainerStarted","Data":"78dd475d38758688870fa415943ce0078afcaabfa229bf5668e451d0852c2ad5"} Jun 09 04:19:01.884100 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.884074 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" event={"ID":"cafe6f486dffca6906cacfbb14ec640b","Type":"ContainerStarted","Data":"f7a089a67d6175915d083e4f706458d2e1158513c02087340d5a34a3e875cb85"} Jun 09 04:19:01.885372 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.885338 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerStarted","Data":"63f0ea419e59f5707eebfc89702a2103936147068101d1d282b86da333e4e986"} Jun 09 04:19:01.886402 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.886371 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mnh49" event={"ID":"9661392c-e0aa-48fa-8bc2-906c1ac58200","Type":"ContainerStarted","Data":"718ddd2596b77eecf4c531c7a1e31cdc5cc78a14aedcf3944778e4b5051f927c"} Jun 09 04:19:01.887511 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.887485 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp78k" event={"ID":"ed958935-96d6-4907-a9e5-34baea7692ca","Type":"ContainerStarted","Data":"7077f69c92acf01f52174f1349ad80b3a66fa0f125c9b76c96f50fe1db551b7e"} Jun 09 04:19:01.888661 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.888630 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29djf" event={"ID":"7f999be1-dcf7-47c5-a686-2be18f8e5c6a","Type":"ContainerStarted","Data":"3f6820d67845c91a3e9987eb26134d8673bc7f52df6c9ba8b504367d42a66c3b"} Jun 09 04:19:01.889641 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.889623 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rqwmp" event={"ID":"73689180-35c0-4259-b343-6a0116039fff","Type":"ContainerStarted","Data":"eb91b1e280c1f7bbe172fd2eabb73888a2af9a6b312da639459986017435935d"} Jun 09 04:19:01.896268 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:01.896229 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-201.ec2.internal" podStartSLOduration=1.896216669 podStartE2EDuration="1.896216669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:01.895946941 +0000 UTC m=+3.462657961" watchObservedRunningTime="2026-06-09 04:19:01.896216669 +0000 UTC m=+3.462927748" Jun 09 04:19:02.436480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.436395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:02.436480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.436456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:02.436710 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.436619 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:02.436710 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.436683 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:04.436665158 +0000 UTC m=+6.003376180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:02.437078 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.437056 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:02.437480 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.437111 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:04.437097812 +0000 UTC m=+6.003808812 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:02.538045 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.537404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:02.538045 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.537567 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:02.538045 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.537590 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:02.538045 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.537603 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:02.538045 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.537684 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:04.53764501 +0000 UTC m=+6.104356027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:02.840506 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.840393 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 04:14:00 +0000 UTC" deadline="2027-11-22 02:21:54.626717898 +0000 UTC" Jun 09 04:19:02.840506 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.840460 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12742h2m51.786262139s" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.871831 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.871937 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.872244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.872306 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.872347 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:02.872472 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:02.872395 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:02.905320 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.905282 2568 generic.go:356] "Generic (PLEG): container finished" podID="949d526c973c0d4a7c08f951eda71f22" containerID="a030d0b2eee6a7ed54500614d0ed25dfa0f1e4ed35c85232c290395e370200d8" exitCode=0 Jun 09 04:19:02.905533 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:02.905502 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"949d526c973c0d4a7c08f951eda71f22","Type":"ContainerDied","Data":"a030d0b2eee6a7ed54500614d0ed25dfa0f1e4ed35c85232c290395e370200d8"} Jun 09 04:19:03.944252 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:03.944216 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" event={"ID":"949d526c973c0d4a7c08f951eda71f22","Type":"ContainerStarted","Data":"b1880efb464c42e8c12784394de8cf9cedd84646fefa23c8fb65838f38fbfd2f"} Jun 09 04:19:04.454512 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.454472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:04.454695 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.454559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:04.454695 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.454691 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:04.454799 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.454755 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:08.454736604 +0000 UTC m=+10.021447604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:04.455118 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.455099 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:04.455204 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.455181 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:08.455165307 +0000 UTC m=+10.021876307 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:04.555704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.555667 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:04.555905 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.555863 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:04.555905 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.555883 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:04.555905 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.555896 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:04.556064 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.555952 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:08.555935201 +0000 UTC m=+10.122646202 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.871234 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.871368 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.871598 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.871717 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:04.871736 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:04.871941 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:04.871824 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:06.870618 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:06.870574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:06.871056 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:06.870582 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:06.871056 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:06.870723 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:06.871056 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:06.870824 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:06.871056 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:06.870593 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:06.871056 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:06.870951 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:08.488953 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.488910 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:08.489414 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.488961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:08.489414 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.489043 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:08.489414 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.489043 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:08.489414 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.489102 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:16.489081852 +0000 UTC m=+18.055792848 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:08.489414 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.489120 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:16.489110513 +0000 UTC m=+18.055821514 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:08.590279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.590243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:08.590492 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.590472 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:08.590550 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.590498 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:08.590550 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.590511 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:08.590622 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.590571 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:16.590552047 +0000 UTC m=+18.157263063 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:08.869601 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.869531 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:08.869748 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.869630 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:08.869921 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.869901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:08.869993 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.869969 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:08.870030 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:08.870004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:08.870082 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:08.870065 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:10.873798 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:10.873762 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:10.874333 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:10.873860 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:10.874333 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:10.873870 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:10.874333 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:10.873865 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:10.874333 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:10.873987 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:10.874333 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:10.874074 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:12.870045 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:12.870015 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:12.870365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:12.870059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:12.870365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:12.870152 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:12.870365 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:12.870167 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:12.870365 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:12.870220 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:12.870365 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:12.870315 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:14.870209 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:14.870171 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:14.870209 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:14.870184 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:14.870774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:14.870243 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:14.870774 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:14.870355 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:14.870774 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:14.870433 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:14.870774 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:14.870456 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:16.551306 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.551266 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:16.551306 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.551308 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:16.551884 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.551425 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:16.551884 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.551425 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:16.551884 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.551491 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:19:32.55147177 +0000 UTC m=+34.118182775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:16.551884 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.551507 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:19:32.551498432 +0000 UTC m=+34.118209432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:16.652251 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.652223 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:16.652411 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.652368 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:16.652411 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.652385 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:16.652411 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.652393 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:16.652517 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.652446 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:32.652432554 +0000 UTC m=+34.219143554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:16.870006 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.869930 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:16.870202 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.870047 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:16.870202 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.870056 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:16.870202 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.870172 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:16.870202 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:16.869941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:16.870403 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:16.870278 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:18.870574 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:18.870534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:18.871075 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:18.870646 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:18.871075 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:18.871003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:18.871199 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:18.871104 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:18.871199 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:18.871178 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:18.871270 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:18.871250 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:20.870308 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:20.870271 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:20.870308 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:20.870295 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:20.870857 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:20.870396 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:20.870857 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:20.870410 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:20.870857 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:20.870490 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:20.870857 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:20.870559 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:21.992704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:21.992355 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="57aaf143def7dda18210b6d165897787883ca26e5c8c7f31e625611253f348be" exitCode=0 Jun 09 04:19:21.993517 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:21.992452 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"57aaf143def7dda18210b6d165897787883ca26e5c8c7f31e625611253f348be"} Jun 09 04:19:21.994403 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:21.994363 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mnh49" event={"ID":"9661392c-e0aa-48fa-8bc2-906c1ac58200","Type":"ContainerStarted","Data":"96eddf6266b92e77cc067b4414c40c8b6b7c98e893526da116b15729ccf0b49d"} Jun 09 04:19:21.996277 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:21.996249 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hp78k" event={"ID":"ed958935-96d6-4907-a9e5-34baea7692ca","Type":"ContainerStarted","Data":"2a2c8e6ccab63b5c645ad90ab7951242f488c8f716574c0d1ac7556ed8c1208d"} Jun 09 04:19:21.997912 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:21.997885 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rqwmp" event={"ID":"73689180-35c0-4259-b343-6a0116039fff","Type":"ContainerStarted","Data":"680addd3b46c16c5224669ec6c712f6cbae484ce11468226773f3981e4f17b37"} Jun 09 04:19:22.001251 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001234 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:19:22.001623 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001604 2568 generic.go:356] "Generic (PLEG): container finished" podID="99b1ae0a-1808-4b58-914f-c8d16b928399" containerID="8a5ac3a6b297971b27e28bcacb2cd59fc84cdb4759247881f89bcb01eaff2688" exitCode=1 Jun 09 04:19:22.001691 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"73cd0fdc36bab56903e96c7b6fdd6c9f091b0aa9bda43d0aa68d1c2479ce5262"} Jun 09 04:19:22.001760 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"c794c46fa4385decd116782cbbaa62690b67ba5fb3716baa3bd15658937a94aa"} Jun 09 04:19:22.001812 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001801 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"ee3976526f34fe145d939af7c4d31281dccbe65d5f8e13c707f82fb5789bf6e8"} Jun 09 04:19:22.001864 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001855 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"3b22b54f301ef4b5e79a1d5a1019e925524cb6eb2baab78b797f83e073e9cb30"} Jun 09 04:19:22.001914 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerDied","Data":"8a5ac3a6b297971b27e28bcacb2cd59fc84cdb4759247881f89bcb01eaff2688"} Jun 09 04:19:22.001963 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.001945 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"14107e70d7ec0425c5ca878293e2f583b611dcf779513e68a6f691dd56b59d69"} Jun 09 04:19:22.003387 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.003365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lshz7" event={"ID":"bb89ad4e-cb3c-4fe1-b35f-bbdb97014873","Type":"ContainerStarted","Data":"188b28dfd1661b343b91c6bfdf80a9018d1b3de942d2167e2bea8822c7c7a886"} Jun 09 04:19:22.005219 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.005187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g2rkj" event={"ID":"e554b371-885b-45ed-973a-0a62cc7d6bad","Type":"ContainerStarted","Data":"ae357f938448c34c2b6ba811f20b97c8de9a89ad90b560e3ca25dc31b60c0f4c"} Jun 09 04:19:22.006768 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.006742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" event={"ID":"c6483c48-cbc4-416f-9cf2-2707a7676302","Type":"ContainerStarted","Data":"a0671dcf9f65e20f3699e8ae978ad1d311ae1c9a15c339d62a65beb7e02077a9"} Jun 09 04:19:22.013841 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.013792 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-201.ec2.internal" podStartSLOduration=22.01377525 podStartE2EDuration="22.01377525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:19:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:03.959075449 +0000 UTC m=+5.525786469" watchObservedRunningTime="2026-06-09 04:19:22.01377525 +0000 UTC m=+23.580486270" Jun 09 04:19:22.024187 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.024154 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mnh49" podStartSLOduration=11.898463332 podStartE2EDuration="23.02412115s" totalImagesPullingTime="11.125657818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:22.023787054 +0000 UTC m=+23.590498073" watchObservedRunningTime="2026-06-09 04:19:22.02412115 +0000 UTC m=+23.590832169" Jun 09 04:19:22.035279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.035247 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rqwmp" podStartSLOduration=3.921402971 podStartE2EDuration="23.035237482s" totalImagesPullingTime="19.113834511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:22.035106503 +0000 UTC m=+23.601817522" watchObservedRunningTime="2026-06-09 04:19:22.035237482 +0000 UTC m=+23.601948500" Jun 09 04:19:22.049523 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.049490 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g2rkj" podStartSLOduration=3.889951974 podStartE2EDuration="23.049479977s" totalImagesPullingTime="19.159528003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:22.049388036 +0000 UTC m=+23.616099054" watchObservedRunningTime="2026-06-09 04:19:22.049479977 +0000 UTC m=+23.616190995" Jun 09 04:19:22.063115 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.063086 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lshz7" podStartSLOduration=3.92931414 podStartE2EDuration="23.063078388s" totalImagesPullingTime="19.133764248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:22.062992982 +0000 UTC m=+23.629704000" watchObservedRunningTime="2026-06-09 04:19:22.063078388 +0000 UTC m=+23.629789406" Jun 09 04:19:22.074599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.074569 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hp78k" podStartSLOduration=3.989526662 podStartE2EDuration="23.074563775s" totalImagesPullingTime="19.085037113s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:22.074067557 +0000 UTC m=+23.640778587" watchObservedRunningTime="2026-06-09 04:19:22.074563775 +0000 UTC m=+23.641274793" Jun 09 04:19:22.564211 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.564182 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 04:19:22.869863 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.869786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:22.869863 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.869803 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:22.870162 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.869803 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:22.870162 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:22.869910 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:22.870162 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:22.870003 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:22.870162 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:22.870112 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:22.878868 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.878801 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T04:19:22.56420979Z","UUID":"437d8840-c58d-4d16-a552-c90d802d9a46","Handler":null,"Name":"","Endpoint":""} Jun 09 04:19:22.881515 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.881495 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 04:19:22.881617 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:22.881542 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 04:19:23.011608 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:23.011245 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-29djf" event={"ID":"7f999be1-dcf7-47c5-a686-2be18f8e5c6a","Type":"ContainerStarted","Data":"511705cb685b523b3dcc057106cfdbd58767af76bdb42ce88078d34a30b0033c"} Jun 09 04:19:23.014746 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:23.014722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" event={"ID":"c6483c48-cbc4-416f-9cf2-2707a7676302","Type":"ContainerStarted","Data":"de1c3903ced00d1175540801d06c8b9336697ce8f2f207e8cb39cd7252e451de"} Jun 09 04:19:23.024477 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:23.023780 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-29djf" podStartSLOduration=4.929727895 podStartE2EDuration="24.023764857s" totalImagesPullingTime="19.094036962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:23.023555804 +0000 UTC m=+24.590266832" watchObservedRunningTime="2026-06-09 04:19:23.023764857 +0000 UTC m=+24.590475875" Jun 09 04:19:24.020369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.020188 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:19:24.020818 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.020761 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"da45bdef95feea319c153a0cf153921bed0d2fff2f6e253ffbb69588185d274b"} Jun 09 04:19:24.023059 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.023031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" event={"ID":"c6483c48-cbc4-416f-9cf2-2707a7676302","Type":"ContainerStarted","Data":"6395bd3caea3ed5234d33637ab6ae495fa92fe0f26c104424ceda008611d88bc"} Jun 09 04:19:24.039635 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.039556 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b6wqg" podStartSLOduration=3.70499806 podStartE2EDuration="25.039539713s" totalImagesPullingTime="21.334541653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:24.037525227 +0000 UTC m=+25.604236246" watchObservedRunningTime="2026-06-09 04:19:24.039539713 +0000 UTC m=+25.606250733" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.869802 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.869826 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:24.869924 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:24.869974 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:24.870016 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:24.870239 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:24.870125 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:25.956437 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:25.956409 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:25.956994 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:25.956978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:26.870438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:26.870412 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:26.870630 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:26.870418 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:26.870630 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:26.870533 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:26.870742 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:26.870668 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:26.870742 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:26.870722 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:26.870832 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:26.870798 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:28.033402 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.033150 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="231fe23359236d44d716a2083cd8dff57b129e80f6ee713fc271b609c7253741" exitCode=0 Jun 09 04:19:28.034274 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.033221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"231fe23359236d44d716a2083cd8dff57b129e80f6ee713fc271b609c7253741"} Jun 09 04:19:28.043384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.043362 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:19:28.043757 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.043730 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"9d9f72bbb0b7450e3f12e6256ba02db2dc5eed9657bfe6175c950377c9f9574e"} Jun 09 04:19:28.044113 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.044089 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:28.044363 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.044347 2568 scope.go:117] "RemoveContainer" containerID="8a5ac3a6b297971b27e28bcacb2cd59fc84cdb4759247881f89bcb01eaff2688" Jun 09 04:19:28.061688 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.061666 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:28.871351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.871324 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:28.871519 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.871420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:28.871519 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:28.871438 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:28.871631 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:28.871517 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:28.871631 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:28.871584 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:28.871726 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:28.871664 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:29.048443 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.048413 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="370d2b3f1e369155e74a8b51a8c6c45a57416fb2d4cc48c62db23dfea964d937" exitCode=0 Jun 09 04:19:29.048827 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.048489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"370d2b3f1e369155e74a8b51a8c6c45a57416fb2d4cc48c62db23dfea964d937"} Jun 09 04:19:29.052945 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.052928 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:19:29.053393 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.053360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" event={"ID":"99b1ae0a-1808-4b58-914f-c8d16b928399","Type":"ContainerStarted","Data":"01ec019ea783ee8a5620f2fe5c8e34cb2043e2a9c2e11e8d390dcf48d3da9f68"} Jun 09 04:19:29.053630 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.053615 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:29.053674 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.053667 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:29.069587 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.069568 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:19:29.088980 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.088936 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" podStartSLOduration=11.88476086 podStartE2EDuration="31.088923644s" totalImagesPullingTime="19.204162784s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:29.088172769 +0000 UTC m=+30.654883790" watchObservedRunningTime="2026-06-09 04:19:29.088923644 +0000 UTC m=+30.655634678" Jun 09 04:19:29.312228 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.312022 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bpb6w"] Jun 09 04:19:29.312362 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.312301 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:29.312407 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:29.312385 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:29.315224 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.315198 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hb5dm"] Jun 09 04:19:29.315341 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.315288 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:29.315398 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:29.315375 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:29.315802 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.315780 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drz8k"] Jun 09 04:19:29.315900 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:29.315887 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:29.316021 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:29.315995 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:30.557523 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.557457 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:30.558018 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.557605 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 09 04:19:30.558018 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.557978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mnh49" Jun 09 04:19:30.870398 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.870336 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:30.870510 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.870341 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:30.870510 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:30.870434 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:30.870510 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:30.870346 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:30.870603 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:30.870501 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:30.870603 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:30.870588 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:31.059464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:31.059430 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="34977ac253ff237ad3eff506bdeb91a9960367bbf7e6b034abca9be64307d4b6" exitCode=0 Jun 09 04:19:31.059627 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:31.059521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"34977ac253ff237ad3eff506bdeb91a9960367bbf7e6b034abca9be64307d4b6"} Jun 09 04:19:32.576243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.576214 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:32.576796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.576250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:32.576796 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.576398 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:32.576796 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.576411 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:32.576796 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.576467 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:20:04.576449851 +0000 UTC m=+66.143160864 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 04:19:32.576796 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.576483 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret podName:11da152c-7e1f-41a8-9545-e661f523b5ce nodeName:}" failed. No retries permitted until 2026-06-09 04:20:04.576476934 +0000 UTC m=+66.143187934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret") pod "global-pull-secret-syncer-bpb6w" (UID: "11da152c-7e1f-41a8-9545-e661f523b5ce") : object "kube-system"/"original-pull-secret" not registered Jun 09 04:19:32.677198 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.677167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:32.677353 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.677335 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 04:19:32.677420 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.677359 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 04:19:32.677420 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.677368 2568 projected.go:196] Error preparing data for projected volume kube-api-access-d4g84 for pod openshift-network-diagnostics/network-check-target-hb5dm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:32.677420 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.677413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84 podName:2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5 nodeName:}" failed. No retries permitted until 2026-06-09 04:20:04.677398985 +0000 UTC m=+66.244109985 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-d4g84" (UniqueName: "kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84") pod "network-check-target-hb5dm" (UID: "2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 04:19:32.869917 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.869839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:32.870053 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.869955 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:19:32.870053 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.869839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:32.870053 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.870028 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hb5dm" podUID="2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5" Jun 09 04:19:32.870207 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:32.870079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:32.870207 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:32.870172 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bpb6w" podUID="11da152c-7e1f-41a8-9545-e661f523b5ce" Jun 09 04:19:33.765003 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.764928 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-201.ec2.internal" event="NodeReady" Jun 09 04:19:33.765419 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.765077 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 04:19:33.805643 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.805616 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sw8s6"] Jun 09 04:19:33.808107 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.808075 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:33.808538 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.808505 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-smlwz"] Jun 09 04:19:33.810285 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.809971 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 04:19:33.810285 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.810052 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:33.810285 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.810058 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdm29\"" Jun 09 04:19:33.810463 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.810438 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 04:19:33.812534 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.812513 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-c5vr2\"" Jun 09 04:19:33.812651 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.812540 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 04:19:33.812651 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.812557 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 04:19:33.812822 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.812809 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 04:19:33.818412 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.818392 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sw8s6"] Jun 09 04:19:33.821184 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.821117 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smlwz"] Jun 09 04:19:33.987415 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987386 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecddad8a-f092-4b95-9ecc-f67814fc2475-tmp-dir\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:33.987575 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc55f224-b07a-47d9-a383-8a910f261251-cert\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:33.987575 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csns8\" (UniqueName: \"kubernetes.io/projected/fc55f224-b07a-47d9-a383-8a910f261251-kube-api-access-csns8\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:33.987693 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecddad8a-f092-4b95-9ecc-f67814fc2475-config-volume\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:33.987693 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzbtb\" (UniqueName: \"kubernetes.io/projected/ecddad8a-f092-4b95-9ecc-f67814fc2475-kube-api-access-hzbtb\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:33.987693 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:33.987680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089045 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.088961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc55f224-b07a-47d9-a383-8a910f261251-cert\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:34.089045 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089002 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csns8\" (UniqueName: \"kubernetes.io/projected/fc55f224-b07a-47d9-a383-8a910f261251-kube-api-access-csns8\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:34.089274 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089050 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecddad8a-f092-4b95-9ecc-f67814fc2475-config-volume\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089274 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089069 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzbtb\" (UniqueName: \"kubernetes.io/projected/ecddad8a-f092-4b95-9ecc-f67814fc2475-kube-api-access-hzbtb\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089274 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089274 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecddad8a-f092-4b95-9ecc-f67814fc2475-tmp-dir\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089603 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:34.089333 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:34.089603 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:34.089393 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:34.589372491 +0000 UTC m=+36.156083517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:19:34.089603 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ecddad8a-f092-4b95-9ecc-f67814fc2475-tmp-dir\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.089766 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.089678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ecddad8a-f092-4b95-9ecc-f67814fc2475-config-volume\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.093472 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.093440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fc55f224-b07a-47d9-a383-8a910f261251-cert\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:34.098815 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.098783 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csns8\" (UniqueName: \"kubernetes.io/projected/fc55f224-b07a-47d9-a383-8a910f261251-kube-api-access-csns8\") pod \"ingress-canary-smlwz\" (UID: \"fc55f224-b07a-47d9-a383-8a910f261251\") " pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:34.099117 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.099101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzbtb\" (UniqueName: \"kubernetes.io/projected/ecddad8a-f092-4b95-9ecc-f67814fc2475-kube-api-access-hzbtb\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.127632 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.127611 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-smlwz" Jun 09 04:19:34.592394 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.592362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:34.592569 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:34.592505 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:34.592634 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:34.592573 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:35.592555665 +0000 UTC m=+37.159266663 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:19:34.870572 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.870119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:19:34.870572 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.870177 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:19:34.870572 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.870119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:19:34.873392 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.873364 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m5zsz\"" Jun 09 04:19:34.873392 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.873376 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 04:19:34.873554 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.873403 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jr279\"" Jun 09 04:19:34.873679 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.873660 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 04:19:34.874198 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.873858 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 04:19:34.874198 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:34.874024 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 04:19:35.039574 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:35.039452 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-smlwz"] Jun 09 04:19:35.042993 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:19:35.042971 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc55f224_b07a_47d9_a383_8a910f261251.slice/crio-960501d39263cc7d846a131162362b243e71a87317588b7aba51588c2a859d82 WatchSource:0}: Error finding container 960501d39263cc7d846a131162362b243e71a87317588b7aba51588c2a859d82: Status 404 returned error can't find the container with id 960501d39263cc7d846a131162362b243e71a87317588b7aba51588c2a859d82 Jun 09 04:19:35.070366 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:35.070331 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smlwz" event={"ID":"fc55f224-b07a-47d9-a383-8a910f261251","Type":"ContainerStarted","Data":"960501d39263cc7d846a131162362b243e71a87317588b7aba51588c2a859d82"} Jun 09 04:19:35.073266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:35.073247 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerStarted","Data":"d4be72ee7feaeb6609c85a5673020208a5c6b77710a1e132f2d57c56ba964cff"} Jun 09 04:19:35.599092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:35.598719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:35.599092 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:35.598849 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:35.599092 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:35.598922 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:37.59890232 +0000 UTC m=+39.165613337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:19:36.079286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:36.079203 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="d4be72ee7feaeb6609c85a5673020208a5c6b77710a1e132f2d57c56ba964cff" exitCode=0 Jun 09 04:19:36.079286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:36.079274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"d4be72ee7feaeb6609c85a5673020208a5c6b77710a1e132f2d57c56ba964cff"} Jun 09 04:19:37.084026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:37.083741 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-smlwz" event={"ID":"fc55f224-b07a-47d9-a383-8a910f261251","Type":"ContainerStarted","Data":"dbb4223fdbfd4e4cb00fe118eb57586cbe64feb6ece344988dd0b86c8578ce9d"} Jun 09 04:19:37.087052 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:37.087022 2568 generic.go:356] "Generic (PLEG): container finished" podID="de9a4011-c351-490b-bfc2-4d8310d916a4" containerID="e86a72f3dc9a56f9f958f61eb54eabfab52741e3fa2175a44c477980e63cb36f" exitCode=0 Jun 09 04:19:37.087211 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:37.087082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerDied","Data":"e86a72f3dc9a56f9f958f61eb54eabfab52741e3fa2175a44c477980e63cb36f"} Jun 09 04:19:37.097836 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:37.097799 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-smlwz" podStartSLOduration=2.315230695 podStartE2EDuration="4.097785334s" totalImagesPullingTime="1.782554639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:37.096491804 +0000 UTC m=+38.663202844" watchObservedRunningTime="2026-06-09 04:19:37.097785334 +0000 UTC m=+38.664496353" Jun 09 04:19:37.612874 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:37.612850 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:37.613013 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:37.612955 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:37.613013 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:37.613004 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:41.612990438 +0000 UTC m=+43.179701436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:19:38.092398 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:38.092367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" event={"ID":"de9a4011-c351-490b-bfc2-4d8310d916a4","Type":"ContainerStarted","Data":"2d1cbd68f9f277813a84f3e3fa974be0e59ed3495ae772092e1793fb08732801"} Jun 09 04:19:38.113015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:38.112965 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-r7cbb" podStartSLOduration=9.010808154 podStartE2EDuration="39.112950206s" totalImagesPullingTime="30.102142052s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:19:38.111907306 +0000 UTC m=+39.678618324" watchObservedRunningTime="2026-06-09 04:19:38.112950206 +0000 UTC m=+39.679661218" Jun 09 04:19:41.635889 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:41.635854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:41.636400 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:41.635951 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:41.636400 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:41.636002 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:19:49.635988986 +0000 UTC m=+51.202699983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:19:49.686277 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:19:49.686236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:19:49.686835 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:49.686374 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:19:49.686835 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:19:49.686442 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:20:05.686427006 +0000 UTC m=+67.253138002 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:20:01.070420 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:01.070395 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-82vrh" Jun 09 04:20:04.585940 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.585883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:20:04.585940 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.585941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:20:04.588041 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.588020 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 04:20:04.588161 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.588126 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 04:20:04.597019 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:04.597001 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 04:20:04.597072 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:04.597061 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:21:08.597044839 +0000 UTC m=+130.163755849 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : secret "metrics-daemon-secret" not found Jun 09 04:20:04.600811 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.600782 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/11da152c-7e1f-41a8-9545-e661f523b5ce-original-pull-secret\") pod \"global-pull-secret-syncer-bpb6w\" (UID: \"11da152c-7e1f-41a8-9545-e661f523b5ce\") " pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:20:04.687205 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.687173 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:20:04.689444 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.689428 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 04:20:04.699702 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.699682 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 04:20:04.710568 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.710549 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4g84\" (UniqueName: \"kubernetes.io/projected/2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5-kube-api-access-d4g84\") pod \"network-check-target-hb5dm\" (UID: \"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5\") " pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:20:04.885431 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.885362 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jr279\"" Jun 09 04:20:04.891198 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.891173 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bpb6w" Jun 09 04:20:04.893982 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:04.893965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:20:05.020475 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:05.020399 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hb5dm"] Jun 09 04:20:05.026108 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:20:05.026062 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a5a38e9_1ebe_4dbb_9e3e_7f828638d2f5.slice/crio-d9ed705ff59c37ce8db67e0510f0d3d4ecd0fc0ea84ad8124dda9231e4925da5 WatchSource:0}: Error finding container d9ed705ff59c37ce8db67e0510f0d3d4ecd0fc0ea84ad8124dda9231e4925da5: Status 404 returned error can't find the container with id d9ed705ff59c37ce8db67e0510f0d3d4ecd0fc0ea84ad8124dda9231e4925da5 Jun 09 04:20:05.034729 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:05.034702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bpb6w"] Jun 09 04:20:05.036920 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:20:05.036897 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11da152c_7e1f_41a8_9545_e661f523b5ce.slice/crio-50b3d45e9fb58dbb9320821ebdc855b5117ab0a71cb98b30e6a99027dab0503a WatchSource:0}: Error finding container 50b3d45e9fb58dbb9320821ebdc855b5117ab0a71cb98b30e6a99027dab0503a: Status 404 returned error can't find the container with id 50b3d45e9fb58dbb9320821ebdc855b5117ab0a71cb98b30e6a99027dab0503a Jun 09 04:20:05.152874 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:05.152844 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hb5dm" event={"ID":"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5","Type":"ContainerStarted","Data":"d9ed705ff59c37ce8db67e0510f0d3d4ecd0fc0ea84ad8124dda9231e4925da5"} Jun 09 04:20:05.153824 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:05.153803 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bpb6w" event={"ID":"11da152c-7e1f-41a8-9545-e661f523b5ce","Type":"ContainerStarted","Data":"50b3d45e9fb58dbb9320821ebdc855b5117ab0a71cb98b30e6a99027dab0503a"} Jun 09 04:20:05.695818 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:05.695777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:20:05.696300 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:05.695965 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:20:05.696300 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:05.696067 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:20:37.696043136 +0000 UTC m=+99.262754141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:20:10.169209 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:10.169170 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hb5dm" event={"ID":"2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5","Type":"ContainerStarted","Data":"adf806b6225d14fe136bd084da7b8005da3caa813dbc393b0b42b9bc5ceeff85"} Jun 09 04:20:10.169646 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:10.169273 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:20:10.170727 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:10.170706 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bpb6w" event={"ID":"11da152c-7e1f-41a8-9545-e661f523b5ce","Type":"ContainerStarted","Data":"7e70c6b4bec7cc1023a2d150a5a3dc7494ebaf0a2921dd373996018295e752f3"} Jun 09 04:20:10.186047 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:10.186010 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hb5dm" podStartSLOduration=67.471786717 podStartE2EDuration="1m12.185997075s" totalImagesPullingTime="4.714210358s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:20:10.184438863 +0000 UTC m=+71.751149882" watchObservedRunningTime="2026-06-09 04:20:10.185997075 +0000 UTC m=+71.752708094" Jun 09 04:20:10.197708 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:10.197667 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bpb6w" podStartSLOduration=66.49184559 podStartE2EDuration="1m11.197656424s" totalImagesPullingTime="4.705810834s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:20:10.197014459 +0000 UTC m=+71.763725490" watchObservedRunningTime="2026-06-09 04:20:10.197656424 +0000 UTC m=+71.764367443" Jun 09 04:20:37.708787 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:37.708742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:20:37.709267 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:37.708904 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:20:37.709267 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:20:37.708973 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:21:41.708957555 +0000 UTC m=+163.275668552 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:20:41.175538 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:20:41.175499 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hb5dm" Jun 09 04:21:08.603961 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:21:08.603918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:21:08.604500 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:08.604037 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 04:21:08.604500 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:08.604194 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs podName:f4a913c5-8e81-4375-9119-f94141550ecf nodeName:}" failed. No retries permitted until 2026-06-09 04:23:10.604078409 +0000 UTC m=+252.170789406 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs") pod "network-metrics-daemon-drz8k" (UID: "f4a913c5-8e81-4375-9119-f94141550ecf") : secret "metrics-daemon-secret" not found Jun 09 04:21:36.821290 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:36.821234 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sw8s6" podUID="ecddad8a-f092-4b95-9ecc-f67814fc2475" Jun 09 04:21:37.382205 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:21:37.382178 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:21:37.896010 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:37.895961 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-drz8k" podUID="f4a913c5-8e81-4375-9119-f94141550ecf" Jun 09 04:21:41.720331 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:21:41.720292 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:21:41.720705 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:41.720394 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 04:21:41.720705 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:21:41.720442 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls podName:ecddad8a-f092-4b95-9ecc-f67814fc2475 nodeName:}" failed. No retries permitted until 2026-06-09 04:23:43.720428548 +0000 UTC m=+285.287139545 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls") pod "dns-default-sw8s6" (UID: "ecddad8a-f092-4b95-9ecc-f67814fc2475") : secret "dns-default-metrics-tls" not found Jun 09 04:21:50.870324 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:21:50.870241 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:22:06.959877 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.959847 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz"] Jun 09 04:22:06.961668 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.961652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:06.963902 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.963865 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-645bb5c5df-6dmdc"] Jun 09 04:22:06.964235 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.964211 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-d29kd\"" Jun 09 04:22:06.964679 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.964657 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 04:22:06.964771 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.964698 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 04:22:06.965537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.965522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:06.967834 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.967799 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 04:22:06.967972 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.967863 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 04:22:06.967972 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.967927 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mgkrk\"" Jun 09 04:22:06.968077 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.968011 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 04:22:06.973227 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.973210 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 04:22:06.976311 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.976292 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz"] Jun 09 04:22:06.982342 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.982324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fd2cb3-e113-425c-9369-43eae8cb6945-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:06.982421 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.982365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:06.988329 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:06.988310 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-645bb5c5df-6dmdc"] Jun 09 04:22:07.054250 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.054223 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd"] Jun 09 04:22:07.055925 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.055907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" Jun 09 04:22:07.057949 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.057928 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 04:22:07.058446 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.058431 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-nnl6l\"" Jun 09 04:22:07.058446 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.058441 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 04:22:07.060164 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.060125 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m"] Jun 09 04:22:07.061797 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.061761 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.063758 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.063743 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9w4kz\"" Jun 09 04:22:07.064498 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.064483 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 09 04:22:07.064818 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.064802 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 04:22:07.064869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.064833 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 04:22:07.064999 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.064985 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 09 04:22:07.066841 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.066824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd"] Jun 09 04:22:07.078313 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.078288 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m"] Jun 09 04:22:07.082614 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082592 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.082706 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fd2cb3-e113-425c-9369-43eae8cb6945-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:07.082706 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.082706 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b9812a5-a3b2-4470-8b91-77d203674024-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.082849 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082712 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4487\" (UniqueName: \"kubernetes.io/projected/5b9812a5-a3b2-4470-8b91-77d203674024-kube-api-access-j4487\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.082849 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082813 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.082952 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.082952 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.082952 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.082985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.083009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnw54\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.083032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.083043 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:07.083096 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.083052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsp9c\" (UniqueName: \"kubernetes.io/projected/9cca3c15-fe39-4cbc-8686-ae9117979a3c-kube-api-access-vsp9c\") pod \"volume-data-source-validator-78dd696465-gb9gd\" (UID: \"9cca3c15-fe39-4cbc-8686-ae9117979a3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" Jun 09 04:22:07.083392 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.083101 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:07.583080694 +0000 UTC m=+189.149791694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:07.083392 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.083285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e0fd2cb3-e113-425c-9369-43eae8cb6945-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:07.159319 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.159296 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6"] Jun 09 04:22:07.161081 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.161066 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.163343 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.163311 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 04:22:07.163508 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.163488 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 04:22:07.163599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.163523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 04:22:07.163926 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.163909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 04:22:07.164012 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.163950 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-nzkj7\"" Jun 09 04:22:07.164447 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.164430 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rqvvw"] Jun 09 04:22:07.166267 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.166253 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt"] Jun 09 04:22:07.166384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.166371 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.167878 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.167821 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" Jun 09 04:22:07.168254 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.168235 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 04:22:07.168568 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.168548 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 04:22:07.169168 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.169151 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-7twrk\"" Jun 09 04:22:07.169693 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.169674 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 04:22:07.169922 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.169897 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 04:22:07.170199 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.170182 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qzk9c\"" Jun 09 04:22:07.173345 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.173328 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6"] Jun 09 04:22:07.175324 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.175302 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 04:22:07.181071 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.180059 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rqvvw"] Jun 09 04:22:07.183614 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183590 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183722 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183722 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183722 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/134f8ca4-2285-4dbe-910c-56514717c8c6-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59dl\" (UniqueName: \"kubernetes.io/projected/134f8ca4-2285-4dbe-910c-56514717c8c6-kube-api-access-n59dl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183810 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnw54\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183836 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.183894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183860 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsp9c\" (UniqueName: \"kubernetes.io/projected/9cca3c15-fe39-4cbc-8686-ae9117979a3c-kube-api-access-vsp9c\") pod \"volume-data-source-validator-78dd696465-gb9gd\" (UID: \"9cca3c15-fe39-4cbc-8686-ae9117979a3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183904 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b9812a5-a3b2-4470-8b91-77d203674024-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.183990 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4487\" (UniqueName: \"kubernetes.io/projected/5b9812a5-a3b2-4470-8b91-77d203674024-kube-api-access-j4487\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.184012 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134f8ca4-2285-4dbe-910c-56514717c8c6-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.184266 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.184212 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.184557 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.184301 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:07.184557 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.184315 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:07.184557 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.184364 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:07.68434706 +0000 UTC m=+189.251058066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:07.184557 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.184387 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:07.184557 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.184430 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:07.684417966 +0000 UTC m=+189.251128965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:07.184812 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.184606 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.185347 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.185323 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.185448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.185360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/5b9812a5-a3b2-4470-8b91-77d203674024-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.186957 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.186933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.187055 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.186983 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.187681 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.187659 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt"] Jun 09 04:22:07.197982 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.197958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.198057 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.198003 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnw54\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.198181 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.198158 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4487\" (UniqueName: \"kubernetes.io/projected/5b9812a5-a3b2-4470-8b91-77d203674024-kube-api-access-j4487\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.198411 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.198394 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsp9c\" (UniqueName: \"kubernetes.io/projected/9cca3c15-fe39-4cbc-8686-ae9117979a3c-kube-api-access-vsp9c\") pod \"volume-data-source-validator-78dd696465-gb9gd\" (UID: \"9cca3c15-fe39-4cbc-8686-ae9117979a3c\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" Jun 09 04:22:07.284987 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.284937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59dl\" (UniqueName: \"kubernetes.io/projected/134f8ca4-2285-4dbe-910c-56514717c8c6-kube-api-access-n59dl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.284987 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.284965 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-trusted-ca\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.285160 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.284990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-serving-cert\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.285160 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbjd4\" (UniqueName: \"kubernetes.io/projected/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-kube-api-access-nbjd4\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.285160 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj8n9\" (UniqueName: \"kubernetes.io/projected/edea255f-01cd-4984-94c8-f2b829bfed72-kube-api-access-cj8n9\") pod \"network-check-source-dbd9cf844-9qhnt\" (UID: \"edea255f-01cd-4984-94c8-f2b829bfed72\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" Jun 09 04:22:07.285160 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134f8ca4-2285-4dbe-910c-56514717c8c6-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.285361 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285164 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-config\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.285361 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/134f8ca4-2285-4dbe-910c-56514717c8c6-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.285687 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.285667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/134f8ca4-2285-4dbe-910c-56514717c8c6-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.287026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.287010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/134f8ca4-2285-4dbe-910c-56514717c8c6-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.291919 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.291896 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59dl\" (UniqueName: \"kubernetes.io/projected/134f8ca4-2285-4dbe-910c-56514717c8c6-kube-api-access-n59dl\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-r2dw6\" (UID: \"134f8ca4-2285-4dbe-910c-56514717c8c6\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.363862 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.363831 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" Jun 09 04:22:07.385605 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.385583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-serving-cert\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.385709 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.385613 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbjd4\" (UniqueName: \"kubernetes.io/projected/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-kube-api-access-nbjd4\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.385709 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.385639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj8n9\" (UniqueName: \"kubernetes.io/projected/edea255f-01cd-4984-94c8-f2b829bfed72-kube-api-access-cj8n9\") pod \"network-check-source-dbd9cf844-9qhnt\" (UID: \"edea255f-01cd-4984-94c8-f2b829bfed72\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" Jun 09 04:22:07.385709 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.385682 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-config\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.385839 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.385785 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-trusted-ca\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.386536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.386510 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-config\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.386656 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.386634 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-trusted-ca\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.387866 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.387847 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-serving-cert\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.392678 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.392660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj8n9\" (UniqueName: \"kubernetes.io/projected/edea255f-01cd-4984-94c8-f2b829bfed72-kube-api-access-cj8n9\") pod \"network-check-source-dbd9cf844-9qhnt\" (UID: \"edea255f-01cd-4984-94c8-f2b829bfed72\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" Jun 09 04:22:07.392866 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.392843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbjd4\" (UniqueName: \"kubernetes.io/projected/c1430094-dc0b-4b18-9e35-6a0e1cbcdd94-kube-api-access-nbjd4\") pod \"console-operator-668fdbf85c-rqvvw\" (UID: \"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94\") " pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.472049 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.472022 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" Jun 09 04:22:07.482155 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.482116 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd"] Jun 09 04:22:07.484114 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.484085 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:07.485603 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:07.485575 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cca3c15_fe39_4cbc_8686_ae9117979a3c.slice/crio-ae38e8f78df7faba1c85a66cc43b1266eb16842fc10c265bea4bbd0174050179 WatchSource:0}: Error finding container ae38e8f78df7faba1c85a66cc43b1266eb16842fc10c265bea4bbd0174050179: Status 404 returned error can't find the container with id ae38e8f78df7faba1c85a66cc43b1266eb16842fc10c265bea4bbd0174050179 Jun 09 04:22:07.497383 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.497351 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" Jun 09 04:22:07.587715 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.587551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:07.587715 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.587670 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:07.587905 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.587724 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:08.587709868 +0000 UTC m=+190.154420867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:07.620169 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.620124 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6"] Jun 09 04:22:07.623722 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:07.623683 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod134f8ca4_2285_4dbe_910c_56514717c8c6.slice/crio-7197e0cbd340ec07bd7b8556798e78e46bf3a9458cde9afc51f3f4f00a605260 WatchSource:0}: Error finding container 7197e0cbd340ec07bd7b8556798e78e46bf3a9458cde9afc51f3f4f00a605260: Status 404 returned error can't find the container with id 7197e0cbd340ec07bd7b8556798e78e46bf3a9458cde9afc51f3f4f00a605260 Jun 09 04:22:07.635427 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.635403 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-rqvvw"] Jun 09 04:22:07.639565 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:07.639542 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1430094_dc0b_4b18_9e35_6a0e1cbcdd94.slice/crio-e147a361bc8b324553e3ba27d4cc233dc87ab20e083d491f3a4c7006b0519300 WatchSource:0}: Error finding container e147a361bc8b324553e3ba27d4cc233dc87ab20e083d491f3a4c7006b0519300: Status 404 returned error can't find the container with id e147a361bc8b324553e3ba27d4cc233dc87ab20e083d491f3a4c7006b0519300 Jun 09 04:22:07.651920 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.651899 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt"] Jun 09 04:22:07.654482 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:07.654450 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedea255f_01cd_4984_94c8_f2b829bfed72.slice/crio-74c459e1db6dcc34d4d7a0049239a289f20a0501d9a1dc855896c0761f822db8 WatchSource:0}: Error finding container 74c459e1db6dcc34d4d7a0049239a289f20a0501d9a1dc855896c0761f822db8: Status 404 returned error can't find the container with id 74c459e1db6dcc34d4d7a0049239a289f20a0501d9a1dc855896c0761f822db8 Jun 09 04:22:07.688596 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.688578 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:07.688688 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:07.688618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:07.688738 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.688715 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:07.688738 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.688723 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:07.688738 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.688722 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:07.688844 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.688761 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:08.688748857 +0000 UTC m=+190.255459853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:07.688844 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:07.688773 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:08.68876721 +0000 UTC m=+190.255478208 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:08.457645 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.457574 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" event={"ID":"9cca3c15-fe39-4cbc-8686-ae9117979a3c","Type":"ContainerStarted","Data":"ae38e8f78df7faba1c85a66cc43b1266eb16842fc10c265bea4bbd0174050179"} Jun 09 04:22:08.459279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.459213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" event={"ID":"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94","Type":"ContainerStarted","Data":"e147a361bc8b324553e3ba27d4cc233dc87ab20e083d491f3a4c7006b0519300"} Jun 09 04:22:08.461095 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.461028 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" event={"ID":"edea255f-01cd-4984-94c8-f2b829bfed72","Type":"ContainerStarted","Data":"042b2fa245ba72bb13f1b0110fdfb795e2b5c6af0085b363f9a1c64004ceede6"} Jun 09 04:22:08.461095 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.461066 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" event={"ID":"edea255f-01cd-4984-94c8-f2b829bfed72","Type":"ContainerStarted","Data":"74c459e1db6dcc34d4d7a0049239a289f20a0501d9a1dc855896c0761f822db8"} Jun 09 04:22:08.463375 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.463324 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" event={"ID":"134f8ca4-2285-4dbe-910c-56514717c8c6","Type":"ContainerStarted","Data":"7197e0cbd340ec07bd7b8556798e78e46bf3a9458cde9afc51f3f4f00a605260"} Jun 09 04:22:08.479365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.479181 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-9qhnt" podStartSLOduration=1.479167337 podStartE2EDuration="1.479167337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:08.477299499 +0000 UTC m=+190.044010544" watchObservedRunningTime="2026-06-09 04:22:08.479167337 +0000 UTC m=+190.045878355" Jun 09 04:22:08.594461 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.594417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:08.594652 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.594571 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:08.594652 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.594639 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:10.594618143 +0000 UTC m=+192.161329152 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.695535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:08.695658 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.695806 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.695880 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:10.695859538 +0000 UTC m=+192.262570537 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.695905 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.695928 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:08.696258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:08.695987 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:10.695969739 +0000 UTC m=+192.262680740 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:10.612142 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:10.612091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:10.612454 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.612237 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:10.612454 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.612302 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:14.612286721 +0000 UTC m=+196.178997722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:10.713325 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:10.713296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:10.713441 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:10.713361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:10.713441 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.713427 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:10.713525 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.713489 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:14.713473283 +0000 UTC m=+196.280184280 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:10.713525 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.713496 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:10.713525 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.713509 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:10.713623 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:10.713556 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:14.713540596 +0000 UTC m=+196.280251616 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:11.473701 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.473662 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" event={"ID":"134f8ca4-2285-4dbe-910c-56514717c8c6","Type":"ContainerStarted","Data":"007c992365b02e6ef32520f3eca03b5b5c79a6763552434cc2168f1665a03a41"} Jun 09 04:22:11.475191 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.475164 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" event={"ID":"9cca3c15-fe39-4cbc-8686-ae9117979a3c","Type":"ContainerStarted","Data":"e430836e205fd87b8c7a528897c08d0239354b35cebc07dae4f22ebd7fcff3e9"} Jun 09 04:22:11.476643 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.476621 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/0.log" Jun 09 04:22:11.476760 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.476657 2568 generic.go:356] "Generic (PLEG): container finished" podID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" containerID="e290f8ef7ed9a8f92852f004a9b24ccfc24ba56fa5b99035ae7666b3911790c0" exitCode=255 Jun 09 04:22:11.476760 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.476702 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" event={"ID":"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94","Type":"ContainerDied","Data":"e290f8ef7ed9a8f92852f004a9b24ccfc24ba56fa5b99035ae7666b3911790c0"} Jun 09 04:22:11.476908 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.476894 2568 scope.go:117] "RemoveContainer" containerID="e290f8ef7ed9a8f92852f004a9b24ccfc24ba56fa5b99035ae7666b3911790c0" Jun 09 04:22:11.489474 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.489425 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" podStartSLOduration=1.700882688 podStartE2EDuration="4.489408795s" totalImagesPullingTime="2.788526107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:11.488460812 +0000 UTC m=+193.055171831" watchObservedRunningTime="2026-06-09 04:22:11.489408795 +0000 UTC m=+193.056119815" Jun 09 04:22:11.517017 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:11.516948 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-gb9gd" podStartSLOduration=1.594252897 podStartE2EDuration="4.516927353s" totalImagesPullingTime="2.922674456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:11.516294816 +0000 UTC m=+193.083005836" watchObservedRunningTime="2026-06-09 04:22:11.516927353 +0000 UTC m=+193.083638374" Jun 09 04:22:12.481040 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481009 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/1.log" Jun 09 04:22:12.481593 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481426 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/0.log" Jun 09 04:22:12.481593 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481472 2568 generic.go:356] "Generic (PLEG): container finished" podID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" exitCode=255 Jun 09 04:22:12.481593 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481546 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" event={"ID":"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94","Type":"ContainerDied","Data":"25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d"} Jun 09 04:22:12.481769 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481612 2568 scope.go:117] "RemoveContainer" containerID="e290f8ef7ed9a8f92852f004a9b24ccfc24ba56fa5b99035ae7666b3911790c0" Jun 09 04:22:12.481824 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:12.481806 2568 scope.go:117] "RemoveContainer" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" Jun 09 04:22:12.482014 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:12.481985 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:13.486367 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:13.486339 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/1.log" Jun 09 04:22:13.486756 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:13.486662 2568 scope.go:117] "RemoveContainer" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" Jun 09 04:22:13.486819 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:13.486798 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:14.640240 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:14.640203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:14.640624 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.640350 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:14.640624 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.640413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:22.640397453 +0000 UTC m=+204.207108450 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:14.741026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:14.740993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:14.741158 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:14.741043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:14.741234 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.741170 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:14.741234 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.741173 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:14.741332 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.741245 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:22.741226958 +0000 UTC m=+204.307937984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:14.741332 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.741180 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:14.741332 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:14.741309 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:22.741295024 +0000 UTC m=+204.308006024 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:17.484965 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.484931 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:17.485356 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.484977 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:17.485356 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.485267 2568 scope.go:117] "RemoveContainer" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" Jun 09 04:22:17.485427 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:17.485398 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:17.872125 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.872040 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bq9d8"] Jun 09 04:22:17.874864 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.874838 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:17.877901 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.877877 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 04:22:17.878007 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.877915 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 04:22:17.878877 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.878864 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 04:22:17.878934 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.878881 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 04:22:17.878995 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.878898 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2gswn\"" Jun 09 04:22:17.885594 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.885575 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bq9d8"] Jun 09 04:22:17.961879 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.961853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/771bd76f-811b-4470-a82e-703034bdc20d-signing-key\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:17.962024 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.961961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mjvs\" (UniqueName: \"kubernetes.io/projected/771bd76f-811b-4470-a82e-703034bdc20d-kube-api-access-8mjvs\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:17.962065 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:17.962035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/771bd76f-811b-4470-a82e-703034bdc20d-signing-cabundle\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.063088 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.063065 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mjvs\" (UniqueName: \"kubernetes.io/projected/771bd76f-811b-4470-a82e-703034bdc20d-kube-api-access-8mjvs\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.063219 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.063113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/771bd76f-811b-4470-a82e-703034bdc20d-signing-cabundle\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.063219 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.063162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/771bd76f-811b-4470-a82e-703034bdc20d-signing-key\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.063792 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.063769 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/771bd76f-811b-4470-a82e-703034bdc20d-signing-cabundle\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.065441 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.065425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/771bd76f-811b-4470-a82e-703034bdc20d-signing-key\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.070636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.070615 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mjvs\" (UniqueName: \"kubernetes.io/projected/771bd76f-811b-4470-a82e-703034bdc20d-kube-api-access-8mjvs\") pod \"service-ca-7d74d578b8-bq9d8\" (UID: \"771bd76f-811b-4470-a82e-703034bdc20d\") " pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.183415 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.183391 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" Jun 09 04:22:18.239658 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.239630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp78k_ed958935-96d6-4907-a9e5-34baea7692ca/dns-node-resolver/0.log" Jun 09 04:22:18.305974 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.305943 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-bq9d8"] Jun 09 04:22:18.309045 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:18.309022 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771bd76f_811b_4470_a82e_703034bdc20d.slice/crio-000f89c99c0e103444acca9ffa52d6119dedfdccc46dd0526a5105f7429d2ddd WatchSource:0}: Error finding container 000f89c99c0e103444acca9ffa52d6119dedfdccc46dd0526a5105f7429d2ddd: Status 404 returned error can't find the container with id 000f89c99c0e103444acca9ffa52d6119dedfdccc46dd0526a5105f7429d2ddd Jun 09 04:22:18.504599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:18.504522 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" event={"ID":"771bd76f-811b-4470-a82e-703034bdc20d","Type":"ContainerStarted","Data":"000f89c99c0e103444acca9ffa52d6119dedfdccc46dd0526a5105f7429d2ddd"} Jun 09 04:22:19.241252 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:19.241226 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rqwmp_73689180-35c0-4259-b343-6a0116039fff/node-ca/0.log" Jun 09 04:22:20.039886 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:20.039852 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smlwz_fc55f224-b07a-47d9-a383-8a910f261251/serve-healthcheck-canary/0.log" Jun 09 04:22:20.511820 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:20.511783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" event={"ID":"771bd76f-811b-4470-a82e-703034bdc20d","Type":"ContainerStarted","Data":"9c66cbcd90a32b08d2631be3e42e2f8aca6e205459a249d5654810e62a53dc6a"} Jun 09 04:22:20.526562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:20.526513 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-bq9d8" podStartSLOduration=1.662879854 podStartE2EDuration="3.526494286s" totalImagesPullingTime="1.863614432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:20.524970756 +0000 UTC m=+202.091681806" watchObservedRunningTime="2026-06-09 04:22:20.526494286 +0000 UTC m=+202.093205307" Jun 09 04:22:20.640677 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:20.640648 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-r2dw6_134f8ca4-2285-4dbe-910c-56514717c8c6/kube-storage-version-migrator-operator/0.log" Jun 09 04:22:22.701048 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:22.701015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:22.701449 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.701120 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 04:22:22.701449 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.701190 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert podName:e0fd2cb3-e113-425c-9369-43eae8cb6945 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:38.701176206 +0000 UTC m=+220.267887202 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-z6nxz" (UID: "e0fd2cb3-e113-425c-9369-43eae8cb6945") : secret "networking-console-plugin-cert" not found Jun 09 04:22:22.801444 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:22.801413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:22.801575 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:22.801458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") pod \"image-registry-645bb5c5df-6dmdc\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:22.801575 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.801560 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 04:22:22.801575 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.801560 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:22.801575 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.801570 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-645bb5c5df-6dmdc: secret "image-registry-tls" not found Jun 09 04:22:22.801728 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.801617 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls podName:ddde9020-84d5-4276-ac66-13c5f8eb1947 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:38.801606406 +0000 UTC m=+220.368317403 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls") pod "image-registry-645bb5c5df-6dmdc" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947") : secret "image-registry-tls" not found Jun 09 04:22:22.801728 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:22.801630 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls podName:5b9812a5-a3b2-4470-8b91-77d203674024 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:38.801624524 +0000 UTC m=+220.368335521 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-l9s7m" (UID: "5b9812a5-a3b2-4470-8b91-77d203674024") : secret "cluster-monitoring-operator-tls" not found Jun 09 04:22:31.870346 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:31.870314 2568 scope.go:117] "RemoveContainer" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" Jun 09 04:22:32.550857 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.550832 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:22:32.551251 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.551235 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/1.log" Jun 09 04:22:32.551313 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.551270 2568 generic.go:356] "Generic (PLEG): container finished" podID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" exitCode=255 Jun 09 04:22:32.551363 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.551341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" event={"ID":"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94","Type":"ContainerDied","Data":"561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191"} Jun 09 04:22:32.551410 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.551400 2568 scope.go:117] "RemoveContainer" containerID="25429071d1b0a4de2a0e11acf2ed4059758a8d3518463a61ca318a420c19234d" Jun 09 04:22:32.551707 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:32.551681 2568 scope.go:117] "RemoveContainer" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" Jun 09 04:22:32.551864 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:32.551846 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:33.555184 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:33.555123 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:22:36.423863 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.423825 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645bb5c5df-6dmdc"] Jun 09 04:22:36.424258 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:36.424013 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" podUID="ddde9020-84d5-4276-ac66-13c5f8eb1947" Jun 09 04:22:36.459594 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.459571 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-64949f54dc-76hv9"] Jun 09 04:22:36.462166 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.462150 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.476051 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.476030 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64949f54dc-76hv9"] Jun 09 04:22:36.499671 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.499652 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-krns8"] Jun 09 04:22:36.501688 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.501670 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.503852 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.503817 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 04:22:36.503952 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.503854 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 04:22:36.504158 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.504121 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lqxmq\"" Jun 09 04:22:36.504256 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.504186 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 04:22:36.504317 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.504267 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 04:22:36.513357 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.513336 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krns8"] Jun 09 04:22:36.563447 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.563425 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:36.568178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.568154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:36.602539 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-image-registry-private-configuration\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-trusted-ca\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.602711 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602631 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7qzr\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-kube-api-access-n7qzr\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602744 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-certificates\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-crio-socket\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.602774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-ca-trust-extracted\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602850 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602785 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-bound-sa-token\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602889 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-installation-pull-secrets\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602920 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-tls\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.602951 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6682m\" (UniqueName: \"kubernetes.io/projected/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-api-access-6682m\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.602994 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602956 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.603038 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.602997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-data-volume\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.703489 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703430 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703489 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703472 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703653 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703495 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703653 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnw54\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703653 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703637 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703671 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703721 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets\") pod \"ddde9020-84d5-4276-ac66-13c5f8eb1947\" (UID: \"ddde9020-84d5-4276-ac66-13c5f8eb1947\") " Jun 09 04:22:36.703796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703789 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-certificates\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.703942 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703823 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-crio-socket\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.703942 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703834 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:22:36.703942 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-crio-socket\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.703942 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-ca-trust-extracted\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703982 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:22:36.704175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.703965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-bound-sa-token\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704058 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-installation-pull-secrets\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704123 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-tls\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6682m\" (UniqueName: \"kubernetes.io/projected/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-api-access-6682m\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704229 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-data-volume\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-image-registry-private-configuration\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-trusted-ca\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704354 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.704432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7qzr\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-kube-api-access-n7qzr\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704465 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-trusted-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.704705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704483 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-certificates\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.704705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-ca-trust-extracted\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.704705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704620 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 04:22:36.704891 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-certificates\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.705015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.704992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-data-volume\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.705477 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.705457 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.705863 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.705831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-trusted-ca\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.706612 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.706586 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:22:36.707076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.707048 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54" (OuterVolumeSpecName: "kube-api-access-fnw54") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "kube-api-access-fnw54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:22:36.707206 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.707100 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:22:36.707658 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.707629 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.707748 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.707695 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-installation-pull-secrets\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.708148 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.708104 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-image-registry-private-configuration\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.708249 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.708190 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "ddde9020-84d5-4276-ac66-13c5f8eb1947" (UID: "ddde9020-84d5-4276-ac66-13c5f8eb1947"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:22:36.708508 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.708489 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-registry-tls\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.713455 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.713434 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-bound-sa-token\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.713919 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.713900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7qzr\" (UniqueName: \"kubernetes.io/projected/8d1a46c0-a261-4f68-98f3-bda4bc9ec22f-kube-api-access-n7qzr\") pod \"image-registry-64949f54dc-76hv9\" (UID: \"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f\") " pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.714006 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.713923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6682m\" (UniqueName: \"kubernetes.io/projected/57e1e2f7-83bb-4bd1-ab21-aa935dc3a126-kube-api-access-6682m\") pod \"insights-runtime-extractor-krns8\" (UID: \"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126\") " pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.770551 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.770525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:36.805317 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.805291 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-bound-sa-token\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.805317 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.805316 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnw54\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-kube-api-access-fnw54\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.805459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.805327 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/ddde9020-84d5-4276-ac66-13c5f8eb1947-ca-trust-extracted\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.805459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.805336 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-image-registry-private-configuration\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.805459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.805345 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/ddde9020-84d5-4276-ac66-13c5f8eb1947-installation-pull-secrets\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:36.810236 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.810213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-krns8" Jun 09 04:22:36.902561 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.902531 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-64949f54dc-76hv9"] Jun 09 04:22:36.905334 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:36.905294 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1a46c0_a261_4f68_98f3_bda4bc9ec22f.slice/crio-2d25ce71d102e4f9be5b6cc774b79f8f354f5a5f8548da5e1594b882d78cacc8 WatchSource:0}: Error finding container 2d25ce71d102e4f9be5b6cc774b79f8f354f5a5f8548da5e1594b882d78cacc8: Status 404 returned error can't find the container with id 2d25ce71d102e4f9be5b6cc774b79f8f354f5a5f8548da5e1594b882d78cacc8 Jun 09 04:22:36.949175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:36.948583 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-krns8"] Jun 09 04:22:37.484778 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.484749 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:37.485238 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.484841 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:22:37.485238 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.485180 2568 scope.go:117] "RemoveContainer" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" Jun 09 04:22:37.485374 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:37.485333 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:37.568912 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.568870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" event={"ID":"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f","Type":"ContainerStarted","Data":"e9fb413412cc20912dbd1f1a294767da0bcff4c60de66c9a90e620ac80084692"} Jun 09 04:22:37.569058 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.568930 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" event={"ID":"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f","Type":"ContainerStarted","Data":"2d25ce71d102e4f9be5b6cc774b79f8f354f5a5f8548da5e1594b882d78cacc8"} Jun 09 04:22:37.569058 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.568970 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:22:37.570564 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.570536 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krns8" event={"ID":"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126","Type":"ContainerStarted","Data":"dcc14f3fabfaab2127cf7b064d01c049972e2b2e9cbd3583cd934735e994a9ed"} Jun 09 04:22:37.570664 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.570600 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krns8" event={"ID":"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126","Type":"ContainerStarted","Data":"70d671860d9943ab8842b7362003d706c4ef92a98cb052013de839d984f7b9f3"} Jun 09 04:22:37.570733 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.570712 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-645bb5c5df-6dmdc" Jun 09 04:22:37.570830 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.570813 2568 scope.go:117] "RemoveContainer" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" Jun 09 04:22:37.571007 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:37.570981 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:37.585879 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.585835 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podStartSLOduration=1.585817504 podStartE2EDuration="1.585817504s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:37.585372698 +0000 UTC m=+219.152083717" watchObservedRunningTime="2026-06-09 04:22:37.585817504 +0000 UTC m=+219.152528527" Jun 09 04:22:37.607044 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.607020 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-645bb5c5df-6dmdc"] Jun 09 04:22:37.610643 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.610623 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-645bb5c5df-6dmdc"] Jun 09 04:22:37.714263 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:37.713980 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/ddde9020-84d5-4276-ac66-13c5f8eb1947-registry-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:22:38.575642 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.575603 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krns8" event={"ID":"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126","Type":"ContainerStarted","Data":"e34c0684b56a47a19708cc2b712a302f81f1b9a4efdbf908042da1a933438c69"} Jun 09 04:22:38.721344 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.721294 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:38.723971 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.723941 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e0fd2cb3-e113-425c-9369-43eae8cb6945-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-z6nxz\" (UID: \"e0fd2cb3-e113-425c-9369-43eae8cb6945\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:38.772678 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.772649 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" Jun 09 04:22:38.822270 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.822241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:38.824894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.824869 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/5b9812a5-a3b2-4470-8b91-77d203674024-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-l9s7m\" (UID: \"5b9812a5-a3b2-4470-8b91-77d203674024\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:38.871619 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.871539 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" Jun 09 04:22:38.875049 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:38.875024 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ddde9020-84d5-4276-ac66-13c5f8eb1947" path="/var/lib/kubelet/pods/ddde9020-84d5-4276-ac66-13c5f8eb1947/volumes" Jun 09 04:22:39.411350 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:39.411322 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz"] Jun 09 04:22:39.414200 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:39.414176 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0fd2cb3_e113_425c_9369_43eae8cb6945.slice/crio-631bd32247bfb9ecc62b1645fa07e1f4e02b8aeac64a413f577f796abf3d90b4 WatchSource:0}: Error finding container 631bd32247bfb9ecc62b1645fa07e1f4e02b8aeac64a413f577f796abf3d90b4: Status 404 returned error can't find the container with id 631bd32247bfb9ecc62b1645fa07e1f4e02b8aeac64a413f577f796abf3d90b4 Jun 09 04:22:39.427704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:39.427683 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m"] Jun 09 04:22:39.431219 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:39.431195 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b9812a5_a3b2_4470_8b91_77d203674024.slice/crio-7ff69e034d350ebdb0cc04df72c18797104a5cf49f1ee873a989d9236181d484 WatchSource:0}: Error finding container 7ff69e034d350ebdb0cc04df72c18797104a5cf49f1ee873a989d9236181d484: Status 404 returned error can't find the container with id 7ff69e034d350ebdb0cc04df72c18797104a5cf49f1ee873a989d9236181d484 Jun 09 04:22:39.582981 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:39.582920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" event={"ID":"e0fd2cb3-e113-425c-9369-43eae8cb6945","Type":"ContainerStarted","Data":"631bd32247bfb9ecc62b1645fa07e1f4e02b8aeac64a413f577f796abf3d90b4"} Jun 09 04:22:39.583979 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:39.583959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" event={"ID":"5b9812a5-a3b2-4470-8b91-77d203674024","Type":"ContainerStarted","Data":"7ff69e034d350ebdb0cc04df72c18797104a5cf49f1ee873a989d9236181d484"} Jun 09 04:22:40.590610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:40.590573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-krns8" event={"ID":"57e1e2f7-83bb-4bd1-ab21-aa935dc3a126","Type":"ContainerStarted","Data":"8c9a0308747d9512da404029c005f54de331f97571388544a2f5f5fd6c7812dd"} Jun 09 04:22:40.609348 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:40.609298 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-krns8" podStartSLOduration=2.011876881 podStartE2EDuration="4.609277815s" totalImagesPullingTime="2.597400934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:22:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:40.608254627 +0000 UTC m=+222.174965647" watchObservedRunningTime="2026-06-09 04:22:40.609277815 +0000 UTC m=+222.175988835" Jun 09 04:22:41.595585 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:41.595550 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" event={"ID":"e0fd2cb3-e113-425c-9369-43eae8cb6945","Type":"ContainerStarted","Data":"3924f84afe9b88e338393554783c24b41b956bcba164aac3af8e63b47e28a113"} Jun 09 04:22:41.610036 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:41.609990 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-z6nxz" podStartSLOduration=34.168984292 podStartE2EDuration="35.609971667s" totalImagesPullingTime="1.440987375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:41.608862822 +0000 UTC m=+223.175573838" watchObservedRunningTime="2026-06-09 04:22:41.609971667 +0000 UTC m=+223.176682686" Jun 09 04:22:42.389997 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.389922 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz"] Jun 09 04:22:42.393093 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.393077 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:42.395013 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.394988 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 09 04:22:42.395124 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.395031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-6vtlv\"" Jun 09 04:22:42.400599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.400577 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz"] Jun 09 04:22:42.553610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.553577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10d6b572-ef7d-48f4-9725-5d958b6fda00-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5bnrz\" (UID: \"10d6b572-ef7d-48f4-9725-5d958b6fda00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:42.599929 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.599902 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" event={"ID":"5b9812a5-a3b2-4470-8b91-77d203674024","Type":"ContainerStarted","Data":"fd999d501af20ef402b9315a437f4211a665c93aed587de13c51a2cd5d343074"} Jun 09 04:22:42.614400 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.614360 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-l9s7m" podStartSLOduration=33.107111647 podStartE2EDuration="35.614345961s" totalImagesPullingTime="2.507234314s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:42.613923838 +0000 UTC m=+224.180634860" watchObservedRunningTime="2026-06-09 04:22:42.614345961 +0000 UTC m=+224.181056980" Jun 09 04:22:42.654120 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.654100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10d6b572-ef7d-48f4-9725-5d958b6fda00-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5bnrz\" (UID: \"10d6b572-ef7d-48f4-9725-5d958b6fda00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:42.656482 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.656459 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/10d6b572-ef7d-48f4-9725-5d958b6fda00-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-5bnrz\" (UID: \"10d6b572-ef7d-48f4-9725-5d958b6fda00\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:42.703910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.703890 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:42.831709 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:42.831680 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz"] Jun 09 04:22:42.834716 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:42.834693 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d6b572_ef7d_48f4_9725_5d958b6fda00.slice/crio-35b49cc8f43df45e9000cc4bf541df2e0187d657dfa33ee761ab8340645d378b WatchSource:0}: Error finding container 35b49cc8f43df45e9000cc4bf541df2e0187d657dfa33ee761ab8340645d378b: Status 404 returned error can't find the container with id 35b49cc8f43df45e9000cc4bf541df2e0187d657dfa33ee761ab8340645d378b Jun 09 04:22:43.605179 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:43.605120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" event={"ID":"10d6b572-ef7d-48f4-9725-5d958b6fda00","Type":"ContainerStarted","Data":"35b49cc8f43df45e9000cc4bf541df2e0187d657dfa33ee761ab8340645d378b"} Jun 09 04:22:44.610171 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:44.610120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" event={"ID":"10d6b572-ef7d-48f4-9725-5d958b6fda00","Type":"ContainerStarted","Data":"c073f51f7df460bb50154088a3903ea6bd6e1af9b251bc7f699ac1f2d6bec197"} Jun 09 04:22:44.610562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:44.610371 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:44.615563 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:44.615538 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" Jun 09 04:22:44.624359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:44.624316 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-5bnrz" podStartSLOduration=1.599535896 podStartE2EDuration="2.624302346s" totalImagesPullingTime="1.02476645s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:44.623420096 +0000 UTC m=+226.190131114" watchObservedRunningTime="2026-06-09 04:22:44.624302346 +0000 UTC m=+226.191013439" Jun 09 04:22:49.782224 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.782115 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc"] Jun 09 04:22:49.785644 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.785623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:49.787740 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.787721 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-75qj5\"" Jun 09 04:22:49.788483 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.788460 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 04:22:49.788584 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.788532 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 04:22:49.788584 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.788557 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 04:22:49.793862 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.793836 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xbqlf"] Jun 09 04:22:49.796675 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.796657 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc"] Jun 09 04:22:49.796769 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.796755 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.799279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.799257 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 04:22:49.799725 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.799463 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 04:22:49.799725 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.799571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vvz98\"" Jun 09 04:22:49.799725 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.799618 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 04:22:49.800022 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.800001 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq"] Jun 09 04:22:49.803462 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.803413 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.806988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.806971 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-grmpr\"" Jun 09 04:22:49.807121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.806991 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 09 04:22:49.807293 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.807055 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 09 04:22:49.807612 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.807593 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 09 04:22:49.813875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.813857 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq"] Jun 09 04:22:49.870398 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.870378 2568 scope.go:117] "RemoveContainer" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" Jun 09 04:22:49.870587 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:49.870566 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-rqvvw_openshift-console-operator(c1430094-dc0b-4b18-9e35-6a0e1cbcdd94)\"" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podUID="c1430094-dc0b-4b18-9e35-6a0e1cbcdd94" Jun 09 04:22:49.907426 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907405 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-metrics-client-ca\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907509 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907431 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.907509 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907452 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-root\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907509 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.907626 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2cbx\" (UniqueName: \"kubernetes.io/projected/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-kube-api-access-r2cbx\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907626 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:49.907626 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907614 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.907724 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.907724 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907685 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-textfile\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907797 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907730 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907797 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvpq9\" (UniqueName: \"kubernetes.io/projected/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-kube-api-access-xvpq9\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:49.907868 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:49.907868 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907821 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.907936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907876 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-wtmp\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-sys\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.907936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8trbn\" (UniqueName: \"kubernetes.io/projected/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-api-access-8trbn\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:49.908074 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:49.908074 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:49.907989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.008438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008417 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.008530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.008530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-textfile\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.008661 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.008721 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvpq9\" (UniqueName: \"kubernetes.io/projected/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-kube-api-access-xvpq9\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.008774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.008774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008732 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-textfile\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.008774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.008921 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-wtmp\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.008921 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-sys\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.008921 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.008883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010098 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8trbn\" (UniqueName: \"kubernetes.io/projected/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-api-access-8trbn\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-metrics-client-ca\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010879 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-metrics-client-ca\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.010899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:50.011352 2568 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.011728 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.011843 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-sys\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.012017 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-wtmp\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.013308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-accelerators-collector-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.013530 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.013833 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:50.013689 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls podName:4c3587e4-a970-48fe-a01d-9d4b6ad1cd16 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:50.513669858 +0000 UTC m=+232.080380861 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-2zjhc" (UID: "4c3587e4-a970-48fe-a01d-9d4b6ad1cd16") : secret "openshift-state-metrics-tls" not found Jun 09 04:22:50.014544 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.014293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.014717 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.014648 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.014842 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.014829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-root\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.014976 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.014964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.015150 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.015118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2cbx\" (UniqueName: \"kubernetes.io/projected/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-kube-api-access-r2cbx\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.015317 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.015303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.015651 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.015337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-root\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.016011 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.015864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.019161 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.016468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.019161 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:50.017121 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 04:22:50.019161 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.017565 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.020957 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:50.020850 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls podName:509e8e8d-f97b-4cac-8d0b-dc85c78cc878 nodeName:}" failed. No retries permitted until 2026-06-09 04:22:50.520825825 +0000 UTC m=+232.087536840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls") pod "node-exporter-xbqlf" (UID: "509e8e8d-f97b-4cac-8d0b-dc85c78cc878") : secret "node-exporter-tls" not found Jun 09 04:22:50.024175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.023931 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.025159 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.025090 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvpq9\" (UniqueName: \"kubernetes.io/projected/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-kube-api-access-xvpq9\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.027397 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.027364 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2cbx\" (UniqueName: \"kubernetes.io/projected/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-kube-api-access-r2cbx\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.029165 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.029105 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8trbn\" (UniqueName: \"kubernetes.io/projected/05543f3d-e4e3-42a1-9558-ec4f2afb84b6-kube-api-access-8trbn\") pod \"kube-state-metrics-57bbf8bfb5-pfrfq\" (UID: \"05543f3d-e4e3-42a1-9558-ec4f2afb84b6\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.114939 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.114890 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" Jun 09 04:22:50.244614 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.244590 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq"] Jun 09 04:22:50.247052 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:50.247024 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05543f3d_e4e3_42a1_9558_ec4f2afb84b6.slice/crio-ed66e4ca24e14914328670816b14aa13573d8825fc67732b04e754775c4b20d9 WatchSource:0}: Error finding container ed66e4ca24e14914328670816b14aa13573d8825fc67732b04e754775c4b20d9: Status 404 returned error can't find the container with id ed66e4ca24e14914328670816b14aa13573d8825fc67732b04e754775c4b20d9 Jun 09 04:22:50.520722 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.520690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.523186 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.523167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4c3587e4-a970-48fe-a01d-9d4b6ad1cd16-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-2zjhc\" (UID: \"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.621088 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.621053 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.623374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.623348 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/509e8e8d-f97b-4cac-8d0b-dc85c78cc878-node-exporter-tls\") pod \"node-exporter-xbqlf\" (UID: \"509e8e8d-f97b-4cac-8d0b-dc85c78cc878\") " pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.629988 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.629963 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" event={"ID":"05543f3d-e4e3-42a1-9558-ec4f2afb84b6","Type":"ContainerStarted","Data":"ed66e4ca24e14914328670816b14aa13573d8825fc67732b04e754775c4b20d9"} Jun 09 04:22:50.695689 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.695666 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" Jun 09 04:22:50.707606 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.707579 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xbqlf" Jun 09 04:22:50.717783 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:50.717757 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509e8e8d_f97b_4cac_8d0b_dc85c78cc878.slice/crio-a2ab3e2755b5af300165a2febe3dbba931cfb2f002a96a91a18a846ae8bfcfb1 WatchSource:0}: Error finding container a2ab3e2755b5af300165a2febe3dbba931cfb2f002a96a91a18a846ae8bfcfb1: Status 404 returned error can't find the container with id a2ab3e2755b5af300165a2febe3dbba931cfb2f002a96a91a18a846ae8bfcfb1 Jun 09 04:22:50.835555 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.835527 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc"] Jun 09 04:22:50.838014 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:50.837985 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c3587e4_a970_48fe_a01d_9d4b6ad1cd16.slice/crio-5aead2c7277992d5738b59484d8ea9bdbccf2b78f26171f0bf7176ceaab69e36 WatchSource:0}: Error finding container 5aead2c7277992d5738b59484d8ea9bdbccf2b78f26171f0bf7176ceaab69e36: Status 404 returned error can't find the container with id 5aead2c7277992d5738b59484d8ea9bdbccf2b78f26171f0bf7176ceaab69e36 Jun 09 04:22:50.846313 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.846288 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:22:50.850625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.850602 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.852749 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.852837 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.852749 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853012 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mcktf\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853219 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853225 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853324 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853386 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853570 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 04:22:50.854026 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.853818 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 04:22:50.862374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:50.862345 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:22:51.025810 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.025810 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.025810 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025834 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025934 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025958 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn5qs\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026027 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.025983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026329 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.026008 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026329 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.026063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026329 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.026092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.026329 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.026119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.126879 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.126879 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126919 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126934 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn5qs\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126967 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.126987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.127011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.127031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.127052 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.127147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.127599 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.127169 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.128984 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.128023 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.128984 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.128952 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.129886 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.129823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.130358 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.130310 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.131509 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.131460 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.131727 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.131674 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.131822 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.131800 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.132610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.132568 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.133106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.132831 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.133706 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.133659 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.134110 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.134070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.134490 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.134457 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.135519 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.135502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn5qs\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs\") pod \"alertmanager-main-0\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.177064 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.177039 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:22:51.345360 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.345315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:22:51.596723 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:51.596694 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f442209_749c_486e_973d_fe68028f0b63.slice/crio-ffd5b4e542660da15818e94e22ae1546fedadd4df0840581de1fe0f024c5759e WatchSource:0}: Error finding container ffd5b4e542660da15818e94e22ae1546fedadd4df0840581de1fe0f024c5759e: Status 404 returned error can't find the container with id ffd5b4e542660da15818e94e22ae1546fedadd4df0840581de1fe0f024c5759e Jun 09 04:22:51.635400 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.635367 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbqlf" event={"ID":"509e8e8d-f97b-4cac-8d0b-dc85c78cc878","Type":"ContainerStarted","Data":"a2ab3e2755b5af300165a2febe3dbba931cfb2f002a96a91a18a846ae8bfcfb1"} Jun 09 04:22:51.637625 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.637584 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" event={"ID":"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16","Type":"ContainerStarted","Data":"8c1cd697575a2bb4eabdaa8656fe9225eed855b99f6ace7f4433d058736f31a8"} Jun 09 04:22:51.637745 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.637649 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" event={"ID":"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16","Type":"ContainerStarted","Data":"6e03461e64fa493623f817e38870390f5015029a21301b20030d88f194773260"} Jun 09 04:22:51.637745 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.637679 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" event={"ID":"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16","Type":"ContainerStarted","Data":"5aead2c7277992d5738b59484d8ea9bdbccf2b78f26171f0bf7176ceaab69e36"} Jun 09 04:22:51.638882 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:51.638859 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"ffd5b4e542660da15818e94e22ae1546fedadd4df0840581de1fe0f024c5759e"} Jun 09 04:22:52.645080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.645044 2568 generic.go:356] "Generic (PLEG): container finished" podID="509e8e8d-f97b-4cac-8d0b-dc85c78cc878" containerID="c78b384ec475dedc6399a7b5e80b9df830b9233c756dee4e4cba590f4a49ecfd" exitCode=0 Jun 09 04:22:52.645499 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.645154 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbqlf" event={"ID":"509e8e8d-f97b-4cac-8d0b-dc85c78cc878","Type":"ContainerDied","Data":"c78b384ec475dedc6399a7b5e80b9df830b9233c756dee4e4cba590f4a49ecfd"} Jun 09 04:22:52.648490 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.647791 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" event={"ID":"4c3587e4-a970-48fe-a01d-9d4b6ad1cd16","Type":"ContainerStarted","Data":"a16f9c12735d3d37fa6d99acb973977bbd18e19dfd07c9bc8967f79b0143372c"} Jun 09 04:22:52.651351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.651305 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" event={"ID":"05543f3d-e4e3-42a1-9558-ec4f2afb84b6","Type":"ContainerStarted","Data":"d67c9122900bc82569a78c0ff6be16de8250dd13fa55c3e36ea2a73408b9f5e0"} Jun 09 04:22:52.651480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.651360 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" event={"ID":"05543f3d-e4e3-42a1-9558-ec4f2afb84b6","Type":"ContainerStarted","Data":"2e0be7d3d6f3b01973be7e9eaa5d5865644d3e9b944131a75af608b0553ba7e6"} Jun 09 04:22:52.651480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.651387 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" event={"ID":"05543f3d-e4e3-42a1-9558-ec4f2afb84b6","Type":"ContainerStarted","Data":"8022fbc1a8f60434607ce280ff34db1d99f24c3d966e49a3a2d68d2e467d577d"} Jun 09 04:22:52.680611 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.680523 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-pfrfq" podStartSLOduration=2.065527167 podStartE2EDuration="3.680507367s" totalImagesPullingTime="1.6149802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:52.678728528 +0000 UTC m=+234.245439546" watchObservedRunningTime="2026-06-09 04:22:52.680507367 +0000 UTC m=+234.247218389" Jun 09 04:22:52.693713 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:52.693089 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-2zjhc" podStartSLOduration=2.269114534 podStartE2EDuration="3.693070544s" totalImagesPullingTime="1.42395601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:52.693025151 +0000 UTC m=+234.259736174" watchObservedRunningTime="2026-06-09 04:22:52.693070544 +0000 UTC m=+234.259781567" Jun 09 04:22:53.656561 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:53.656524 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96" exitCode=0 Jun 09 04:22:53.656938 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:53.656613 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96"} Jun 09 04:22:53.658910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:53.658887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbqlf" event={"ID":"509e8e8d-f97b-4cac-8d0b-dc85c78cc878","Type":"ContainerStarted","Data":"235f8b0c0d83e9cd4ebfe85f7efbded5eb9c6d5781c153a11947212eb0d38f44"} Jun 09 04:22:53.659007 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:53.658932 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xbqlf" event={"ID":"509e8e8d-f97b-4cac-8d0b-dc85c78cc878","Type":"ContainerStarted","Data":"cd82704df8cf00c35a983b1d32b82648f87a0faec6946965c6348517043a2df9"} Jun 09 04:22:53.695796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:53.695741 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xbqlf" podStartSLOduration=3.439090084 podStartE2EDuration="4.695726854s" totalImagesPullingTime="1.146474927s" totalInitContainerRuntime="110.161843ms" isStatefulPod=true podCreationTimestamp="2026-06-09 04:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:53.694311277 +0000 UTC m=+235.261022297" watchObservedRunningTime="2026-06-09 04:22:53.695726854 +0000 UTC m=+235.262437873" Jun 09 04:22:54.084587 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.084517 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-56f6cff5-bf9dv"] Jun 09 04:22:54.087949 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.087929 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.090536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090509 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-58kfk\"" Jun 09 04:22:54.090536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090522 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 09 04:22:54.090536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090535 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 09 04:22:54.090741 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090524 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 09 04:22:54.090741 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090590 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c8lhl3fc32ucj\"" Jun 09 04:22:54.090943 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.090930 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 04:22:54.095838 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.095819 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56f6cff5-bf9dv"] Jun 09 04:22:54.156173 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-client-certs\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156272 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-metrics-server-audit-profiles\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156272 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-896pj\" (UniqueName: \"kubernetes.io/projected/3244d450-973c-430a-b08e-2383117ba326-kube-api-access-896pj\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-tls\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-client-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156374 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.156464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.156416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3244d450-973c-430a-b08e-2383117ba326-audit-log\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.256733 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256706 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-client-certs\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.256859 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-metrics-server-audit-profiles\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.256859 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-896pj\" (UniqueName: \"kubernetes.io/projected/3244d450-973c-430a-b08e-2383117ba326-kube-api-access-896pj\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.256859 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-tls\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.256859 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256849 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-client-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.257050 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.257050 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.256895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3244d450-973c-430a-b08e-2383117ba326-audit-log\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.257460 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.257412 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/3244d450-973c-430a-b08e-2383117ba326-audit-log\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.257783 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.257754 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.257882 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.257799 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/3244d450-973c-430a-b08e-2383117ba326-metrics-server-audit-profiles\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.259522 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.259505 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-tls\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.264636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.260204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-secret-metrics-server-client-certs\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.264636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.260538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/3244d450-973c-430a-b08e-2383117ba326-client-ca-bundle\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.267369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.267341 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-896pj\" (UniqueName: \"kubernetes.io/projected/3244d450-973c-430a-b08e-2383117ba326-kube-api-access-896pj\") pod \"metrics-server-56f6cff5-bf9dv\" (UID: \"3244d450-973c-430a-b08e-2383117ba326\") " pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.398548 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.398483 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:22:54.535459 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.535338 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-56f6cff5-bf9dv"] Jun 09 04:22:54.539397 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:54.539358 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3244d450_973c_430a_b08e_2383117ba326.slice/crio-325d6aac6ea0d8b59d63a26d5caac53d86346ff814ad6a5fff9b27757dd7fd9b WatchSource:0}: Error finding container 325d6aac6ea0d8b59d63a26d5caac53d86346ff814ad6a5fff9b27757dd7fd9b: Status 404 returned error can't find the container with id 325d6aac6ea0d8b59d63a26d5caac53d86346ff814ad6a5fff9b27757dd7fd9b Jun 09 04:22:54.566248 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.566220 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4"] Jun 09 04:22:54.570842 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.570822 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:54.572997 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.572976 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 09 04:22:54.573119 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.573022 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-2xntg\"" Jun 09 04:22:54.582675 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.582615 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4"] Jun 09 04:22:54.659416 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.659397 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2nsn\" (UniqueName: \"kubernetes.io/projected/698ed63b-3172-41c6-8a01-cc32363a5fff-kube-api-access-w2nsn\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:54.659777 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.659424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:54.663177 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.663155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" event={"ID":"3244d450-973c-430a-b08e-2383117ba326","Type":"ContainerStarted","Data":"325d6aac6ea0d8b59d63a26d5caac53d86346ff814ad6a5fff9b27757dd7fd9b"} Jun 09 04:22:54.760369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.760339 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2nsn\" (UniqueName: \"kubernetes.io/projected/698ed63b-3172-41c6-8a01-cc32363a5fff-kube-api-access-w2nsn\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:54.760526 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.760441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:54.760656 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:54.760636 2568 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 09 04:22:54.760730 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:22:54.760698 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert podName:698ed63b-3172-41c6-8a01-cc32363a5fff nodeName:}" failed. No retries permitted until 2026-06-09 04:22:55.260679554 +0000 UTC m=+236.827390556 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-vsbh4" (UID: "698ed63b-3172-41c6-8a01-cc32363a5fff") : secret "monitoring-plugin-cert" not found Jun 09 04:22:54.770774 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:54.770752 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2nsn\" (UniqueName: \"kubernetes.io/projected/698ed63b-3172-41c6-8a01-cc32363a5fff-kube-api-access-w2nsn\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:55.267223 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.267184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:55.270288 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.270263 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/698ed63b-3172-41c6-8a01-cc32363a5fff-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-vsbh4\" (UID: \"698ed63b-3172-41c6-8a01-cc32363a5fff\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:55.484156 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.484112 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:55.623957 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.623927 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4"] Jun 09 04:22:55.627637 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:22:55.627615 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod698ed63b_3172_41c6_8a01_cc32363a5fff.slice/crio-1e0ae1f21f6f4eb00d2f78becac9952659fd3aae06cfaa750b0aceb9264f5c5f WatchSource:0}: Error finding container 1e0ae1f21f6f4eb00d2f78becac9952659fd3aae06cfaa750b0aceb9264f5c5f: Status 404 returned error can't find the container with id 1e0ae1f21f6f4eb00d2f78becac9952659fd3aae06cfaa750b0aceb9264f5c5f Jun 09 04:22:55.673120 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.673089 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e"} Jun 09 04:22:55.673464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.673258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896"} Jun 09 04:22:55.673464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.673309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042"} Jun 09 04:22:55.674829 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:55.674786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" event={"ID":"698ed63b-3172-41c6-8a01-cc32363a5fff","Type":"ContainerStarted","Data":"1e0ae1f21f6f4eb00d2f78becac9952659fd3aae06cfaa750b0aceb9264f5c5f"} Jun 09 04:22:56.683704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.683670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce"} Jun 09 04:22:56.684169 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.683743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e"} Jun 09 04:22:56.684169 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.683788 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerStarted","Data":"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79"} Jun 09 04:22:56.685730 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.685667 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" event={"ID":"3244d450-973c-430a-b08e-2383117ba326","Type":"ContainerStarted","Data":"84d2a27943b9250306368052a1b3530b958c8e43717d04846ba61c2ef52d64e2"} Jun 09 04:22:56.709059 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.709004 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.927955717 podStartE2EDuration="6.7089835s" totalImagesPullingTime="3.764345816s" totalInitContainerRuntime="16.681967ms" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:56.706110079 +0000 UTC m=+238.272821132" watchObservedRunningTime="2026-06-09 04:22:56.7089835 +0000 UTC m=+238.275694521" Jun 09 04:22:56.775610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.775524 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:22:56.775610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:56.775584 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:22:57.691559 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:57.691521 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" event={"ID":"698ed63b-3172-41c6-8a01-cc32363a5fff","Type":"ContainerStarted","Data":"8b732a1b3388124291e88432f59dc300783e8df57ddde244c50c8c7e964c8ea5"} Jun 09 04:22:57.692121 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:57.692101 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:57.696287 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:57.696268 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" Jun 09 04:22:57.707103 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:57.707045 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" podStartSLOduration=2.0971270889999998 podStartE2EDuration="3.707031693s" totalImagesPullingTime="1.609904604s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:56.724478082 +0000 UTC m=+238.291189116" watchObservedRunningTime="2026-06-09 04:22:57.707031693 +0000 UTC m=+239.273742771" Jun 09 04:22:57.707215 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:57.707171 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-vsbh4" podStartSLOduration=2.15349021 podStartE2EDuration="3.7071631s" totalImagesPullingTime="1.55367289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:22:57.705795734 +0000 UTC m=+239.272506754" watchObservedRunningTime="2026-06-09 04:22:57.7071631 +0000 UTC m=+239.273874116" Jun 09 04:22:58.580801 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:58.580768 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:22:58.580956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:22:58.580817 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:04.870673 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:04.870641 2568 scope.go:117] "RemoveContainer" containerID="561c89a475fcbce76e9fa07b0aa4f52bbcc167ad23cbaae590cb38ca5b6af191" Jun 09 04:23:05.639446 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.639407 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-8cggg"] Jun 09 04:23:05.642689 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.642665 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:05.645053 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.645033 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-76nxz\"" Jun 09 04:23:05.645183 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.645077 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 04:23:05.645183 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.645080 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 04:23:05.651016 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.650994 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8cggg"] Jun 09 04:23:05.723973 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.723948 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:23:05.724100 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.724008 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" event={"ID":"c1430094-dc0b-4b18-9e35-6a0e1cbcdd94","Type":"ContainerStarted","Data":"66d9aacf909d2e3e309660465fe036f8020ec962db6f48e8fc84ef29eaf0ce94"} Jun 09 04:23:05.724375 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.724356 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:23:05.728735 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.728718 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" Jun 09 04:23:05.739795 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.739755 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-rqvvw" podStartSLOduration=55.964910863 podStartE2EDuration="58.739742543s" totalImagesPullingTime="2.77483168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:22:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:05.738960194 +0000 UTC m=+247.305671225" watchObservedRunningTime="2026-06-09 04:23:05.739742543 +0000 UTC m=+247.306453561" Jun 09 04:23:05.756183 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.756163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6r76\" (UniqueName: \"kubernetes.io/projected/5f4e562f-6d0a-4674-be92-c35b5cdc16eb-kube-api-access-d6r76\") pod \"downloads-6657875f97-8cggg\" (UID: \"5f4e562f-6d0a-4674-be92-c35b5cdc16eb\") " pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:05.857397 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.857359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6r76\" (UniqueName: \"kubernetes.io/projected/5f4e562f-6d0a-4674-be92-c35b5cdc16eb-kube-api-access-d6r76\") pod \"downloads-6657875f97-8cggg\" (UID: \"5f4e562f-6d0a-4674-be92-c35b5cdc16eb\") " pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:05.865144 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.865095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6r76\" (UniqueName: \"kubernetes.io/projected/5f4e562f-6d0a-4674-be92-c35b5cdc16eb-kube-api-access-d6r76\") pod \"downloads-6657875f97-8cggg\" (UID: \"5f4e562f-6d0a-4674-be92-c35b5cdc16eb\") " pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:05.951993 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:05.951965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:06.080362 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:06.080221 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-8cggg"] Jun 09 04:23:06.083006 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:23:06.082979 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f4e562f_6d0a_4674_be92_c35b5cdc16eb.slice/crio-f80aafc4c04af9a85440f83903e5085bd708bb62c43fa8cadf957d2e8a322cb2 WatchSource:0}: Error finding container f80aafc4c04af9a85440f83903e5085bd708bb62c43fa8cadf957d2e8a322cb2: Status 404 returned error can't find the container with id f80aafc4c04af9a85440f83903e5085bd708bb62c43fa8cadf957d2e8a322cb2 Jun 09 04:23:06.730513 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:06.730465 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8cggg" event={"ID":"5f4e562f-6d0a-4674-be92-c35b5cdc16eb","Type":"ContainerStarted","Data":"f80aafc4c04af9a85440f83903e5085bd708bb62c43fa8cadf957d2e8a322cb2"} Jun 09 04:23:06.776610 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:06.776577 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:06.776796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:06.776632 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:08.580623 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:08.580588 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:08.581089 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:08.580643 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:10.701992 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:10.701948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:23:10.704743 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:10.704711 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f4a913c5-8e81-4375-9119-f94141550ecf-metrics-certs\") pod \"network-metrics-daemon-drz8k\" (UID: \"f4a913c5-8e81-4375-9119-f94141550ecf\") " pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:23:10.973714 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:10.973631 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-m5zsz\"" Jun 09 04:23:10.981404 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:10.981377 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-drz8k" Jun 09 04:23:11.155126 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:11.155105 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-drz8k"] Jun 09 04:23:11.158006 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:23:11.157965 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a913c5_8e81_4375_9119_f94141550ecf.slice/crio-4af4a5a2d0d3ee30fa62da69acac78f95723ee0e08c0b3161d9e9385a7e915bb WatchSource:0}: Error finding container 4af4a5a2d0d3ee30fa62da69acac78f95723ee0e08c0b3161d9e9385a7e915bb: Status 404 returned error can't find the container with id 4af4a5a2d0d3ee30fa62da69acac78f95723ee0e08c0b3161d9e9385a7e915bb Jun 09 04:23:11.755074 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:11.755030 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drz8k" event={"ID":"f4a913c5-8e81-4375-9119-f94141550ecf","Type":"ContainerStarted","Data":"4af4a5a2d0d3ee30fa62da69acac78f95723ee0e08c0b3161d9e9385a7e915bb"} Jun 09 04:23:12.761312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:12.761274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drz8k" event={"ID":"f4a913c5-8e81-4375-9119-f94141550ecf","Type":"ContainerStarted","Data":"3c4b8b3c2acdcd83126a1de3192acc1cfa7715d8d3e91ca1d4f61545594259e4"} Jun 09 04:23:12.761709 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:12.761349 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-drz8k" event={"ID":"f4a913c5-8e81-4375-9119-f94141550ecf","Type":"ContainerStarted","Data":"4c230babf5fae5a9de953efcca217ef95bcf45b76e90a5fbaaa800b81caecff6"} Jun 09 04:23:12.775358 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:12.775301 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-drz8k" podStartSLOduration=252.738728989 podStartE2EDuration="4m13.775280587s" totalImagesPullingTime="1.036551598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:12.774961782 +0000 UTC m=+254.341672817" watchObservedRunningTime="2026-06-09 04:23:12.775280587 +0000 UTC m=+254.341991608" Jun 09 04:23:14.398850 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:14.398816 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:23:14.399320 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:14.398913 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:23:15.550410 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.550376 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:23:15.553796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.553778 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.556379 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.556353 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 04:23:15.556517 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.556477 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 04:23:15.557206 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.557173 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 04:23:15.557369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.557320 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mr8fk\"" Jun 09 04:23:15.557737 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.557718 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 04:23:15.557981 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.557961 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 04:23:15.584107 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.584055 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:23:15.659968 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.659935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68x26\" (UniqueName: \"kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.660173 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.660015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.660173 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.660039 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.660173 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.660076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.660352 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.660228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.660352 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.660281 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761529 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761688 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761540 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761688 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761563 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68x26\" (UniqueName: \"kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761832 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761832 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761767 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.761939 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.761869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.762420 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.762374 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.762545 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.762492 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.762705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.762617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.764485 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.764461 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.764570 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.764523 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.768594 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.768576 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68x26\" (UniqueName: \"kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26\") pod \"console-5955c99887-6k22m\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:15.865324 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:15.865233 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:16.775742 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.775663 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:16.776191 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.775734 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:16.776191 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.775784 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:23:16.776399 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.776347 2568 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="registry" containerStatusID={"Type":"cri-o","ID":"e9fb413412cc20912dbd1f1a294767da0bcff4c60de66c9a90e620ac80084692"} pod="openshift-image-registry/image-registry-64949f54dc-76hv9" containerMessage="Container registry failed liveness probe, will be restarted" Jun 09 04:23:16.781200 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.781085 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:16.781200 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:16.781151 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:22.113320 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.113297 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:23:22.123585 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:23:22.123554 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5453f77_94c5_44a7_b64b_3750a8796a61.slice/crio-0e962a4daff8b88484e880be248da0ab8567dcdfd451d81b06be2168a2ee6f48 WatchSource:0}: Error finding container 0e962a4daff8b88484e880be248da0ab8567dcdfd451d81b06be2168a2ee6f48: Status 404 returned error can't find the container with id 0e962a4daff8b88484e880be248da0ab8567dcdfd451d81b06be2168a2ee6f48 Jun 09 04:23:22.813889 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.813819 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5955c99887-6k22m" event={"ID":"d5453f77-94c5-44a7-b64b-3750a8796a61","Type":"ContainerStarted","Data":"0e962a4daff8b88484e880be248da0ab8567dcdfd451d81b06be2168a2ee6f48"} Jun 09 04:23:22.816928 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.816900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-8cggg" event={"ID":"5f4e562f-6d0a-4674-be92-c35b5cdc16eb","Type":"ContainerStarted","Data":"6629e781d39bd77975ee2a38afc2986fd7806ef648e5858f8119af55684d332c"} Jun 09 04:23:22.817408 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.817386 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:22.830345 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.830318 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-8cggg" Jun 09 04:23:22.833630 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:22.833588 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-8cggg" podStartSLOduration=1.837042985 podStartE2EDuration="17.833568369s" totalImagesPullingTime="15.996525384s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:23:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:22.832676236 +0000 UTC m=+264.399387256" watchObservedRunningTime="2026-06-09 04:23:22.833568369 +0000 UTC m=+264.400279395" Jun 09 04:23:24.136374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.136262 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:23:24.167779 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.167740 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:23:24.167960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.167897 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.175471 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.175439 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 04:23:24.345050 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345014 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345287 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345097 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345363 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345283 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345363 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345337 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345512 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345399 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345512 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345445 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w92mr\" (UniqueName: \"kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.345512 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.345483 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.446598 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w92mr\" (UniqueName: \"kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.446796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.446796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446687 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.446796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446753 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.446796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.447029 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.447029 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.446864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.447408 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.447382 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.447515 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.447452 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.448003 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.447926 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.448278 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.448257 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.449860 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.449835 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.450422 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.450398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.454509 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.454479 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w92mr\" (UniqueName: \"kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr\") pod \"console-7bb6c6f55d-88llq\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:24.481608 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:24.481578 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:25.955527 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:25.955497 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:23:25.960403 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:23:25.960373 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc87567c_7c79_4544_bf9c_56c803b86e09.slice/crio-17b9ae33c4356291e662fc418806e0aa420a1a8e8284e45ad936be4f73a61729 WatchSource:0}: Error finding container 17b9ae33c4356291e662fc418806e0aa420a1a8e8284e45ad936be4f73a61729: Status 404 returned error can't find the container with id 17b9ae33c4356291e662fc418806e0aa420a1a8e8284e45ad936be4f73a61729 Jun 09 04:23:26.781257 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.781171 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:26.781257 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.781227 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:26.839695 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.839656 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5955c99887-6k22m" event={"ID":"d5453f77-94c5-44a7-b64b-3750a8796a61","Type":"ContainerStarted","Data":"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5"} Jun 09 04:23:26.842202 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.842171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c6f55d-88llq" event={"ID":"fc87567c-7c79-4544-bf9c-56c803b86e09","Type":"ContainerStarted","Data":"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37"} Jun 09 04:23:26.842338 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.842218 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c6f55d-88llq" event={"ID":"fc87567c-7c79-4544-bf9c-56c803b86e09","Type":"ContainerStarted","Data":"17b9ae33c4356291e662fc418806e0aa420a1a8e8284e45ad936be4f73a61729"} Jun 09 04:23:26.857983 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.857937 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5955c99887-6k22m" podStartSLOduration=7.791013984 podStartE2EDuration="11.857920622s" totalImagesPullingTime="4.066906638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:23:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:26.856307455 +0000 UTC m=+268.423018475" watchObservedRunningTime="2026-06-09 04:23:26.857920622 +0000 UTC m=+268.424631642" Jun 09 04:23:26.873280 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:26.873227 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bb6c6f55d-88llq" podStartSLOduration=2.324437046 podStartE2EDuration="2.873207058s" totalImagesPullingTime="548.770012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:23:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:26.870526146 +0000 UTC m=+268.437237173" watchObservedRunningTime="2026-06-09 04:23:26.873207058 +0000 UTC m=+268.439918086" Jun 09 04:23:31.867531 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:31.867495 2568 generic.go:356] "Generic (PLEG): container finished" podID="134f8ca4-2285-4dbe-910c-56514717c8c6" containerID="007c992365b02e6ef32520f3eca03b5b5c79a6763552434cc2168f1665a03a41" exitCode=0 Jun 09 04:23:31.867949 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:31.867573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" event={"ID":"134f8ca4-2285-4dbe-910c-56514717c8c6","Type":"ContainerDied","Data":"007c992365b02e6ef32520f3eca03b5b5c79a6763552434cc2168f1665a03a41"} Jun 09 04:23:31.867949 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:31.867882 2568 scope.go:117] "RemoveContainer" containerID="007c992365b02e6ef32520f3eca03b5b5c79a6763552434cc2168f1665a03a41" Jun 09 04:23:32.875115 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:32.875084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-r2dw6" event={"ID":"134f8ca4-2285-4dbe-910c-56514717c8c6","Type":"ContainerStarted","Data":"c2e00e4c4ccde0982c5b89f915b060f12e8b8914a3a24c43371e97033f55d98c"} Jun 09 04:23:34.403775 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.403748 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:23:34.407585 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.407564 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-56f6cff5-bf9dv" Jun 09 04:23:34.482636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.482611 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:34.482807 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.482666 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:34.483837 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.483815 2568 patch_prober.go:28] interesting pod/console-7bb6c6f55d-88llq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" start-of-body= Jun 09 04:23:34.483954 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:34.483859 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bb6c6f55d-88llq" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" probeResult="failure" output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" Jun 09 04:23:35.866227 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:35.866198 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:35.866623 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:35.866247 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:23:35.867438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:35.867416 2568 patch_prober.go:28] interesting pod/console-5955c99887-6k22m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jun 09 04:23:35.867558 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:35.867464 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5955c99887-6k22m" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jun 09 04:23:36.780412 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:36.780380 2568 patch_prober.go:28] interesting pod/image-registry-64949f54dc-76hv9 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 04:23:36.780597 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:36.780428 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 04:23:37.469210 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:37.469172 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/init-config-reloader/0.log" Jun 09 04:23:37.668556 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:37.668507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/alertmanager/0.log" Jun 09 04:23:37.868700 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:37.868644 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/config-reloader/0.log" Jun 09 04:23:38.068648 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:38.068619 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/kube-rbac-proxy-web/0.log" Jun 09 04:23:38.268608 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:38.268579 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/kube-rbac-proxy/0.log" Jun 09 04:23:38.469855 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:38.469828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/kube-rbac-proxy-metric/0.log" Jun 09 04:23:38.668935 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:38.668909 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6f442209-749c-486e-973d-fe68028f0b63/prom-label-proxy/0.log" Jun 09 04:23:38.869986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:38.869940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-l9s7m_5b9812a5-a3b2-4470-8b91-77d203674024/cluster-monitoring-operator/0.log" Jun 09 04:23:39.068697 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:39.068624 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-state-metrics/0.log" Jun 09 04:23:39.268943 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:39.268893 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-rbac-proxy-main/0.log" Jun 09 04:23:39.468467 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:39.468441 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-rbac-proxy-self/0.log" Jun 09 04:23:39.668984 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:39.668955 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56f6cff5-bf9dv_3244d450-973c-430a-b08e-2383117ba326/metrics-server/0.log" Jun 09 04:23:39.869560 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:39.869484 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vsbh4_698ed63b-3172-41c6-8a01-cc32363a5fff/monitoring-plugin/0.log" Jun 09 04:23:40.383042 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:23:40.383001 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sw8s6" podUID="ecddad8a-f092-4b95-9ecc-f67814fc2475" Jun 09 04:23:40.906004 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:40.905973 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:41.268637 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:41.268566 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/init-textfile/0.log" Jun 09 04:23:41.469866 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:41.469847 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/node-exporter/0.log" Jun 09 04:23:41.668018 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:41.667994 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/kube-rbac-proxy/0.log" Jun 09 04:23:41.798249 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:41.798221 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" podUID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerName="registry" containerID="cri-o://e9fb413412cc20912dbd1f1a294767da0bcff4c60de66c9a90e620ac80084692" gracePeriod=30 Jun 09 04:23:41.868880 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:41.868862 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/kube-rbac-proxy-main/0.log" Jun 09 04:23:42.070653 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:42.070589 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/kube-rbac-proxy-self/0.log" Jun 09 04:23:42.269090 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:42.269058 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/openshift-state-metrics/0.log" Jun 09 04:23:43.727605 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.727576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:43.730016 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.729999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ecddad8a-f092-4b95-9ecc-f67814fc2475-metrics-tls\") pod \"dns-default-sw8s6\" (UID: \"ecddad8a-f092-4b95-9ecc-f67814fc2475\") " pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:43.908725 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.908695 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wdm29\"" Jun 09 04:23:43.917236 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.917216 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:43.919023 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.919002 2568 generic.go:356] "Generic (PLEG): container finished" podID="8d1a46c0-a261-4f68-98f3-bda4bc9ec22f" containerID="e9fb413412cc20912dbd1f1a294767da0bcff4c60de66c9a90e620ac80084692" exitCode=0 Jun 09 04:23:43.919114 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.919088 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" event={"ID":"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f","Type":"ContainerDied","Data":"e9fb413412cc20912dbd1f1a294767da0bcff4c60de66c9a90e620ac80084692"} Jun 09 04:23:43.919207 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.919191 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" event={"ID":"8d1a46c0-a261-4f68-98f3-bda4bc9ec22f","Type":"ContainerStarted","Data":"b4377876dd433ce2386393580247287855e80c64f835f084da944ac49b8ab5be"} Jun 09 04:23:43.919384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:43.919367 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:23:44.081546 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:44.081515 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sw8s6"] Jun 09 04:23:44.084598 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:23:44.084572 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecddad8a_f092_4b95_9ecc_f67814fc2475.slice/crio-34ea4a7ad0ea4ed910e67d2191f01befc32e39b92099267b78ce24d121685952 WatchSource:0}: Error finding container 34ea4a7ad0ea4ed910e67d2191f01befc32e39b92099267b78ce24d121685952: Status 404 returned error can't find the container with id 34ea4a7ad0ea4ed910e67d2191f01befc32e39b92099267b78ce24d121685952 Jun 09 04:23:44.268967 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:44.268915 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-5bnrz_10d6b572-ef7d-48f4-9725-5d958b6fda00/prometheus-operator-admission-webhook/0.log" Jun 09 04:23:44.482244 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:44.482219 2568 patch_prober.go:28] interesting pod/console-7bb6c6f55d-88llq container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" start-of-body= Jun 09 04:23:44.482333 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:44.482265 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7bb6c6f55d-88llq" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" probeResult="failure" output="Get \"https://10.133.0.26:8443/health\": dial tcp 10.133.0.26:8443: connect: connection refused" Jun 09 04:23:44.925182 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:44.925150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw8s6" event={"ID":"ecddad8a-f092-4b95-9ecc-f67814fc2475","Type":"ContainerStarted","Data":"34ea4a7ad0ea4ed910e67d2191f01befc32e39b92099267b78ce24d121685952"} Jun 09 04:23:45.668477 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.668445 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-z6nxz_e0fd2cb3-e113-425c-9369-43eae8cb6945/networking-console-plugin/0.log" Jun 09 04:23:45.865833 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.865805 2568 patch_prober.go:28] interesting pod/console-5955c99887-6k22m container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body= Jun 09 04:23:45.865928 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.865859 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-5955c99887-6k22m" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" Jun 09 04:23:45.868283 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.868262 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:23:45.930936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.930857 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw8s6" event={"ID":"ecddad8a-f092-4b95-9ecc-f67814fc2475","Type":"ContainerStarted","Data":"0c16d6f303115e160a8835042475ce03a562e1fe665cef9e94beb4f8a13aaebe"} Jun 09 04:23:45.930936 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.930903 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sw8s6" event={"ID":"ecddad8a-f092-4b95-9ecc-f67814fc2475","Type":"ContainerStarted","Data":"efcd1d9c1409f717e2d19d3caf5b4c8500dd2af9758543ffca3e120d1d3a7b07"} Jun 09 04:23:45.931350 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.930992 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:45.947063 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:45.947022 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sw8s6" podStartSLOduration=251.348030444 podStartE2EDuration="4m12.947009183s" totalImagesPullingTime="1.598978739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:19:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:23:45.946324553 +0000 UTC m=+287.513035573" watchObservedRunningTime="2026-06-09 04:23:45.947009183 +0000 UTC m=+287.513720248" Jun 09 04:23:46.070087 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:46.070066 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/3.log" Jun 09 04:23:46.269094 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:46.269023 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5955c99887-6k22m_d5453f77-94c5-44a7-b64b-3750a8796a61/console/0.log" Jun 09 04:23:46.469242 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:46.469207 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-7bb6c6f55d-88llq_fc87567c-7c79-4544-bf9c-56c803b86e09/console/0.log" Jun 09 04:23:46.669848 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:46.669828 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8cggg_5f4e562f-6d0a-4674-be92-c35b5cdc16eb/download-server/0.log" Jun 09 04:23:47.668658 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:47.668633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw8s6_ecddad8a-f092-4b95-9ecc-f67814fc2475/dns/0.log" Jun 09 04:23:47.869325 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:47.869279 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw8s6_ecddad8a-f092-4b95-9ecc-f67814fc2475/kube-rbac-proxy/0.log" Jun 09 04:23:48.469412 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:48.469390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp78k_ed958935-96d6-4907-a9e5-34baea7692ca/dns-node-resolver/0.log" Jun 09 04:23:48.869977 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:48.869898 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64949f54dc-76hv9_8d1a46c0-a261-4f68-98f3-bda4bc9ec22f/registry/1.log" Jun 09 04:23:49.468657 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:49.468630 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rqwmp_73689180-35c0-4259-b343-6a0116039fff/node-ca/0.log" Jun 09 04:23:50.268244 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:50.268212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smlwz_fc55f224-b07a-47d9-a383-8a910f261251/serve-healthcheck-canary/0.log" Jun 09 04:23:54.486842 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:54.486814 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:54.490550 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:54.490527 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:23:54.544631 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:54.544600 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:23:55.937413 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:55.937383 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sw8s6" Jun 09 04:23:58.820572 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:58.820543 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:23:58.822312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:58.822291 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:23:58.829019 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:58.829002 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:23:58.830527 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:58.830495 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:23:58.832462 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:23:58.832445 2568 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 04:24:04.929379 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:04.929353 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-64949f54dc-76hv9" Jun 09 04:24:09.973645 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.973608 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:09.974030 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.973907 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="alertmanager" containerID="cri-o://f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" gracePeriod=120 Jun 09 04:24:09.974030 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.974000 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-metric" containerID="cri-o://579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" gracePeriod=120 Jun 09 04:24:09.974178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.974041 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy" containerID="cri-o://36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" gracePeriod=120 Jun 09 04:24:09.974178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.974063 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="config-reloader" containerID="cri-o://c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" gracePeriod=120 Jun 09 04:24:09.974178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.974045 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-web" containerID="cri-o://228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" gracePeriod=120 Jun 09 04:24:09.974178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:09.974064 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="prom-label-proxy" containerID="cri-o://51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" gracePeriod=120 Jun 09 04:24:11.052875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052844 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" exitCode=0 Jun 09 04:24:11.052875 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052873 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" exitCode=0 Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052882 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" exitCode=0 Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052892 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" exitCode=0 Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052905 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e"} Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052963 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce"} Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.052990 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896"} Jun 09 04:24:11.053204 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.053015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042"} Jun 09 04:24:11.221871 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.221847 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:11.361869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361791 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.361869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361839 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361869 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361898 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361944 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361968 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.361989 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362021 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362054 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362118 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362177 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362218 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn5qs\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362241 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets\") pod \"6f442209-749c-486e-973d-fe68028f0b63\" (UID: \"6f442209-749c-486e-973d-fe68028f0b63\") " Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362355 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:11.362448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362360 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:11.362766 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362547 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.362766 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.362615 2568 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6f442209-749c-486e-973d-fe68028f0b63-metrics-client-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.363147 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.363077 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 04:24:11.364940 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.364898 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out" (OuterVolumeSpecName: "config-out") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 04:24:11.365290 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.365257 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.365659 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.365623 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume" (OuterVolumeSpecName: "config-volume") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.365659 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.365638 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.365941 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.365924 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:24:11.366286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.366256 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.366380 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.366365 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs" (OuterVolumeSpecName: "kube-api-access-xn5qs") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "kube-api-access-xn5qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:24:11.366441 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.366389 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.370381 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.370292 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.376975 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.376956 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config" (OuterVolumeSpecName: "web-config") pod "6f442209-749c-486e-973d-fe68028f0b63" (UID: "6f442209-749c-486e-973d-fe68028f0b63"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:11.464017 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.463998 2568 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-web-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464017 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464028 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn5qs\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-kube-api-access-xn5qs\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464037 2568 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6f442209-749c-486e-973d-fe68028f0b63-tls-assets\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464045 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-main-tls\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464053 2568 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-config-out\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464060 2568 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-config-volume\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464068 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464077 2568 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-cluster-tls-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464086 2568 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6f442209-749c-486e-973d-fe68028f0b63-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:11.464106 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:11.464094 2568 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6f442209-749c-486e-973d-fe68028f0b63-alertmanager-main-db\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:12.061530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061497 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" exitCode=0 Jun 09 04:24:12.061530 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061522 2568 generic.go:356] "Generic (PLEG): container finished" podID="6f442209-749c-486e-973d-fe68028f0b63" containerID="228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" exitCode=0 Jun 09 04:24:12.061910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061569 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.061910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061578 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79"} Jun 09 04:24:12.061910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061648 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e"} Jun 09 04:24:12.061910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061677 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6f442209-749c-486e-973d-fe68028f0b63","Type":"ContainerDied","Data":"ffd5b4e542660da15818e94e22ae1546fedadd4df0840581de1fe0f024c5759e"} Jun 09 04:24:12.061910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.061708 2568 scope.go:117] "RemoveContainer" containerID="51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" Jun 09 04:24:12.071826 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.071811 2568 scope.go:117] "RemoveContainer" containerID="579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" Jun 09 04:24:12.078978 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.078959 2568 scope.go:117] "RemoveContainer" containerID="36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" Jun 09 04:24:12.086267 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.086224 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:12.087226 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.087195 2568 scope.go:117] "RemoveContainer" containerID="228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" Jun 09 04:24:12.089442 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.089423 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:12.094099 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.094083 2568 scope.go:117] "RemoveContainer" containerID="c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" Jun 09 04:24:12.101141 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.101111 2568 scope.go:117] "RemoveContainer" containerID="f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" Jun 09 04:24:12.108286 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.108269 2568 scope.go:117] "RemoveContainer" containerID="4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96" Jun 09 04:24:12.113432 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113412 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:12.113850 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113831 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="alertmanager" Jun 09 04:24:12.113894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113858 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="alertmanager" Jun 09 04:24:12.113894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113888 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy" Jun 09 04:24:12.113956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113898 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy" Jun 09 04:24:12.113956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113914 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="init-config-reloader" Jun 09 04:24:12.113956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113924 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="init-config-reloader" Jun 09 04:24:12.113956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113938 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="config-reloader" Jun 09 04:24:12.113956 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113947 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="config-reloader" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113958 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-web" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113967 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-web" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113979 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-metric" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113988 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-metric" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.113999 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="prom-label-proxy" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114006 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="prom-label-proxy" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114093 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-metric" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114110 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="prom-label-proxy" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114122 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="alertmanager" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114176 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy-web" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114185 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="config-reloader" Jun 09 04:24:12.114185 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.114197 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f442209-749c-486e-973d-fe68028f0b63" containerName="kube-rbac-proxy" Jun 09 04:24:12.117246 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.117223 2568 scope.go:117] "RemoveContainer" containerID="51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" Jun 09 04:24:12.117490 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.117471 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e\": container with ID starting with 51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e not found: ID does not exist" containerID="51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" Jun 09 04:24:12.117567 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.117496 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e"} err="failed to get container status \"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e\": rpc error: code = NotFound desc = could not find container \"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e\": container with ID starting with 51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e not found: ID does not exist" Jun 09 04:24:12.117567 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.117512 2568 scope.go:117] "RemoveContainer" containerID="579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" Jun 09 04:24:12.117768 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.117751 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79\": container with ID starting with 579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79 not found: ID does not exist" containerID="579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" Jun 09 04:24:12.118120 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.117776 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79"} err="failed to get container status \"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79\": rpc error: code = NotFound desc = could not find container \"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79\": container with ID starting with 579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79 not found: ID does not exist" Jun 09 04:24:12.118120 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118115 2568 scope.go:117] "RemoveContainer" containerID="36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" Jun 09 04:24:12.118322 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.118390 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.118373 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce\": container with ID starting with 36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce not found: ID does not exist" containerID="36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" Jun 09 04:24:12.118438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118396 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce"} err="failed to get container status \"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce\": rpc error: code = NotFound desc = could not find container \"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce\": container with ID starting with 36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce not found: ID does not exist" Jun 09 04:24:12.118438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118410 2568 scope.go:117] "RemoveContainer" containerID="228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" Jun 09 04:24:12.118844 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.118825 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e\": container with ID starting with 228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e not found: ID does not exist" containerID="228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" Jun 09 04:24:12.118929 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118848 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e"} err="failed to get container status \"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e\": rpc error: code = NotFound desc = could not find container \"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e\": container with ID starting with 228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e not found: ID does not exist" Jun 09 04:24:12.118929 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.118862 2568 scope.go:117] "RemoveContainer" containerID="c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" Jun 09 04:24:12.119086 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.119070 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896\": container with ID starting with c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896 not found: ID does not exist" containerID="c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" Jun 09 04:24:12.119156 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119089 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896"} err="failed to get container status \"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896\": rpc error: code = NotFound desc = could not find container \"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896\": container with ID starting with c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896 not found: ID does not exist" Jun 09 04:24:12.119156 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119101 2568 scope.go:117] "RemoveContainer" containerID="f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" Jun 09 04:24:12.119377 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.119361 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042\": container with ID starting with f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042 not found: ID does not exist" containerID="f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" Jun 09 04:24:12.119423 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119381 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042"} err="failed to get container status \"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042\": rpc error: code = NotFound desc = could not find container \"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042\": container with ID starting with f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042 not found: ID does not exist" Jun 09 04:24:12.119423 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119399 2568 scope.go:117] "RemoveContainer" containerID="4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96" Jun 09 04:24:12.119614 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:12.119599 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96\": container with ID starting with 4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96 not found: ID does not exist" containerID="4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96" Jun 09 04:24:12.119677 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119616 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96"} err="failed to get container status \"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96\": rpc error: code = NotFound desc = could not find container \"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96\": container with ID starting with 4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96 not found: ID does not exist" Jun 09 04:24:12.119677 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119627 2568 scope.go:117] "RemoveContainer" containerID="51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e" Jun 09 04:24:12.119848 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119831 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e"} err="failed to get container status \"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e\": rpc error: code = NotFound desc = could not find container \"51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e\": container with ID starting with 51b73d6ac2de2e5a766c09f6c1e9db9f2879d4d6df44913455d5e6a3794d819e not found: ID does not exist" Jun 09 04:24:12.119848 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.119847 2568 scope.go:117] "RemoveContainer" containerID="579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79" Jun 09 04:24:12.120043 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120027 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79"} err="failed to get container status \"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79\": rpc error: code = NotFound desc = could not find container \"579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79\": container with ID starting with 579ce36167fb678f84735ee0bdf174a0a5ca87b4acab94ef11160f443f17fd79 not found: ID does not exist" Jun 09 04:24:12.120043 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120042 2568 scope.go:117] "RemoveContainer" containerID="36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce" Jun 09 04:24:12.120294 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120266 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce"} err="failed to get container status \"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce\": rpc error: code = NotFound desc = could not find container \"36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce\": container with ID starting with 36970e5b7b6a36ca5bb50a15f1a9cd347e3fa438cc460fd362811ce26e7af4ce not found: ID does not exist" Jun 09 04:24:12.120294 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120294 2568 scope.go:117] "RemoveContainer" containerID="228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e" Jun 09 04:24:12.120458 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120360 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 04:24:12.120514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120473 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 04:24:12.120514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120473 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mcktf\"" Jun 09 04:24:12.120766 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120743 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e"} err="failed to get container status \"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e\": rpc error: code = NotFound desc = could not find container \"228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e\": container with ID starting with 228cc8903c2de9a633a95c2989cfb5deede4b41e9a51cc402896b78a5a64031e not found: ID does not exist" Jun 09 04:24:12.120826 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120772 2568 scope.go:117] "RemoveContainer" containerID="c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896" Jun 09 04:24:12.121015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120905 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 04:24:12.121015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120951 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 04:24:12.121015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120979 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 04:24:12.121351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121023 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 04:24:12.121351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.120979 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 04:24:12.121351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121078 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896"} err="failed to get container status \"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896\": rpc error: code = NotFound desc = could not find container \"c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896\": container with ID starting with c6b14cba44a2bd48f3ef2fea60249d7d2acba86972babc24a781ef8d4dd41896 not found: ID does not exist" Jun 09 04:24:12.121351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121096 2568 scope.go:117] "RemoveContainer" containerID="f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042" Jun 09 04:24:12.121584 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121352 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042"} err="failed to get container status \"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042\": rpc error: code = NotFound desc = could not find container \"f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042\": container with ID starting with f64df3e5b6efe7788609401e86c462a788c9f1d46c3e0ac5f8a6fc6723e72042 not found: ID does not exist" Jun 09 04:24:12.121584 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121369 2568 scope.go:117] "RemoveContainer" containerID="4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96" Jun 09 04:24:12.121584 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121469 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 04:24:12.121724 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.121635 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96"} err="failed to get container status \"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96\": rpc error: code = NotFound desc = could not find container \"4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96\": container with ID starting with 4b153bf3cd7bbc4e6ca1c5ad28348a6b084b5487b3a155e4f5f7dc8dca061f96 not found: ID does not exist" Jun 09 04:24:12.125867 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.125847 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 04:24:12.130699 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.130679 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:12.168246 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168216 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168359 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168340 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-out\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168409 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168425 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5plsn\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-kube-api-access-5plsn\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168514 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168663 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168663 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.168663 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.168590 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-web-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269118 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-web-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269276 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269276 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269276 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269276 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-out\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269352 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269377 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5plsn\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-kube-api-access-5plsn\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269488 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.269829 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.271545 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.269951 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.271545 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.270343 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.271545 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.271204 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272495 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-volume\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272598 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272468 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272598 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272556 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-config-out\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272705 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272594 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272771 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272708 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.272894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.272875 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-web-config\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.273462 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.273438 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.274048 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.274029 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.274681 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.274661 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.279520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.279500 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5plsn\" (UniqueName: \"kubernetes.io/projected/21b50d76-b534-4ea6-bfb6-bd79817c2d5a-kube-api-access-5plsn\") pod \"alertmanager-main-0\" (UID: \"21b50d76-b534-4ea6-bfb6-bd79817c2d5a\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.429934 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.429911 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 04:24:12.565664 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.565642 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 04:24:12.568151 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:24:12.568106 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21b50d76_b534_4ea6_bfb6_bd79817c2d5a.slice/crio-e7f7b7f7368cac19b42c9a61b6726cfdb8be03463f04eaebadc50d3978146c87 WatchSource:0}: Error finding container e7f7b7f7368cac19b42c9a61b6726cfdb8be03463f04eaebadc50d3978146c87: Status 404 returned error can't find the container with id e7f7b7f7368cac19b42c9a61b6726cfdb8be03463f04eaebadc50d3978146c87 Jun 09 04:24:12.879348 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:12.879277 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f442209-749c-486e-973d-fe68028f0b63" path="/var/lib/kubelet/pods/6f442209-749c-486e-973d-fe68028f0b63/volumes" Jun 09 04:24:13.067480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:13.067448 2568 generic.go:356] "Generic (PLEG): container finished" podID="21b50d76-b534-4ea6-bfb6-bd79817c2d5a" containerID="e74278faacaeaa5dd0cfb01f71c7e044328f2897fe162a0da1281f9c61790c3b" exitCode=0 Jun 09 04:24:13.067878 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:13.067534 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerDied","Data":"e74278faacaeaa5dd0cfb01f71c7e044328f2897fe162a0da1281f9c61790c3b"} Jun 09 04:24:13.067878 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:13.067618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"e7f7b7f7368cac19b42c9a61b6726cfdb8be03463f04eaebadc50d3978146c87"} Jun 09 04:24:14.005655 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.005619 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6475cf8b68-cqzlj"] Jun 09 04:24:14.008233 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.008216 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.010279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010253 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dlxrr\"" Jun 09 04:24:14.010497 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010475 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 04:24:14.010646 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010607 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 04:24:14.010646 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010623 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 04:24:14.010795 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010669 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 04:24:14.010795 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.010779 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 04:24:14.015669 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.015647 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 04:24:14.019177 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.019150 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6475cf8b68-cqzlj"] Jun 09 04:24:14.077052 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077014 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"9c8665de47ed79fdb820b98b77a60aa29a5d7adcb20e3186d9bc8724e41e6904"} Jun 09 04:24:14.077445 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077074 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"39837a9e435b987ec681c7098f7e3196066a5e572691fffde721ccada1cded73"} Jun 09 04:24:14.077445 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077102 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"41b969e794d64d866d533798181f0bfca70ab2af04b6a05f89e3816aa27fefa7"} Jun 09 04:24:14.077445 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"b92c78ada929c66c9b6d11e823dbf8a1ba9698f5b015c304d2152e624f476988"} Jun 09 04:24:14.077445 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077189 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"1ff6b71bec4e5d230ffe31ef2cfca8dd326854ac2696b3307d59fa26da4c1803"} Jun 09 04:24:14.077445 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.077217 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"21b50d76-b534-4ea6-bfb6-bd79817c2d5a","Type":"ContainerStarted","Data":"5ada51af9325f3e976625e3ca85eaeec386674b8b2967f0ae0b3173486938ea9"} Jun 09 04:24:14.084629 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6s74\" (UniqueName: \"kubernetes.io/projected/bf7f236b-46fd-41da-b6f0-7fd4449b3906-kube-api-access-g6s74\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084773 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084773 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084778 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084894 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-serving-certs-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084999 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-federate-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.084999 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.084935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-metrics-client-ca\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.085124 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.085103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.101072 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.101033 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.085247687 podStartE2EDuration="2.101019259s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.771572ms" isStatefulPod=false podCreationTimestamp="2026-06-09 04:24:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:24:14.100254943 +0000 UTC m=+315.666965966" watchObservedRunningTime="2026-06-09 04:24:14.101019259 +0000 UTC m=+315.667730278" Jun 09 04:24:14.186421 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186437 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6s74\" (UniqueName: \"kubernetes.io/projected/bf7f236b-46fd-41da-b6f0-7fd4449b3906-kube-api-access-g6s74\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186562 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-serving-certs-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186821 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-federate-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.186821 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.186598 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-metrics-client-ca\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.187393 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.187316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-serving-certs-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.187393 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.187338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-metrics-client-ca\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.187990 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.187962 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.189171 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.189124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.189287 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.189233 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-secret-telemeter-client\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.189522 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.189501 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-federate-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.189613 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.189587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/bf7f236b-46fd-41da-b6f0-7fd4449b3906-telemeter-client-tls\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.194117 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.194091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6s74\" (UniqueName: \"kubernetes.io/projected/bf7f236b-46fd-41da-b6f0-7fd4449b3906-kube-api-access-g6s74\") pod \"telemeter-client-6475cf8b68-cqzlj\" (UID: \"bf7f236b-46fd-41da-b6f0-7fd4449b3906\") " pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.319550 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.319459 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" Jun 09 04:24:14.455418 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.455392 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6475cf8b68-cqzlj"] Jun 09 04:24:14.457320 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:24:14.457286 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf7f236b_46fd_41da_b6f0_7fd4449b3906.slice/crio-34280d541e947b8bf09c4f83810bfcc7565a4a8af05b36725c48bb0f23e76d27 WatchSource:0}: Error finding container 34280d541e947b8bf09c4f83810bfcc7565a4a8af05b36725c48bb0f23e76d27: Status 404 returned error can't find the container with id 34280d541e947b8bf09c4f83810bfcc7565a4a8af05b36725c48bb0f23e76d27 Jun 09 04:24:14.459382 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:14.459356 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 04:24:15.083712 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:15.083671 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" event={"ID":"bf7f236b-46fd-41da-b6f0-7fd4449b3906","Type":"ContainerStarted","Data":"34280d541e947b8bf09c4f83810bfcc7565a4a8af05b36725c48bb0f23e76d27"} Jun 09 04:24:17.096480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.096407 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" event={"ID":"bf7f236b-46fd-41da-b6f0-7fd4449b3906","Type":"ContainerStarted","Data":"5ec91336a80992c944f4dcd19dc9bf34b290188482f9a46d31f0af63b0f67c43"} Jun 09 04:24:17.096480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.096463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" event={"ID":"bf7f236b-46fd-41da-b6f0-7fd4449b3906","Type":"ContainerStarted","Data":"79ae9853a279abe2aecc69d74fa7b812a4385fe414d638d39cc9a0ef82c046eb"} Jun 09 04:24:17.096844 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.096488 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" event={"ID":"bf7f236b-46fd-41da-b6f0-7fd4449b3906","Type":"ContainerStarted","Data":"349ba1ed51dee837f321581f8d01aa919ecf096fb6c3e9f70273f8f72b81bc1b"} Jun 09 04:24:17.125448 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.125406 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6475cf8b68-cqzlj" podStartSLOduration=1.7638915 podStartE2EDuration="4.1253922s" totalImagesPullingTime="2.3615007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:24:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:24:17.124880929 +0000 UTC m=+318.691591949" watchObservedRunningTime="2026-06-09 04:24:17.1253922 +0000 UTC m=+318.692103274" Jun 09 04:24:17.728408 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.728365 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:24:17.730661 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.730643 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.743326 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.743301 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:24:17.821099 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821074 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821240 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821240 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821240 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsmpt\" (UniqueName: \"kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821240 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821375 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821299 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.821375 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.821324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.921784 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.921755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.921910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.921811 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.921910 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.921859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922108 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922032 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922108 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922270 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsmpt\" (UniqueName: \"kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922270 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922745 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922719 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922879 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.922945 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922899 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.923003 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.922989 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.924486 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.924455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.924600 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.924581 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:17.930166 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:17.930144 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsmpt\" (UniqueName: \"kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt\") pod \"console-65cc444486-wl5zs\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:18.044595 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:18.044544 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:18.184532 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:18.184501 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:24:18.188898 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:24:18.188874 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb74fa311_7034_41ae_8f11_81bf600b641c.slice/crio-4d642543770892016c9fc949ef688cc55280d06b4f08ad3bb709a9b23af49de3 WatchSource:0}: Error finding container 4d642543770892016c9fc949ef688cc55280d06b4f08ad3bb709a9b23af49de3: Status 404 returned error can't find the container with id 4d642543770892016c9fc949ef688cc55280d06b4f08ad3bb709a9b23af49de3 Jun 09 04:24:19.109712 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.109678 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc444486-wl5zs" event={"ID":"b74fa311-7034-41ae-8f11-81bf600b641c","Type":"ContainerStarted","Data":"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd"} Jun 09 04:24:19.109884 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.109736 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc444486-wl5zs" event={"ID":"b74fa311-7034-41ae-8f11-81bf600b641c","Type":"ContainerStarted","Data":"4d642543770892016c9fc949ef688cc55280d06b4f08ad3bb709a9b23af49de3"} Jun 09 04:24:19.126238 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.126195 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65cc444486-wl5zs" podStartSLOduration=2.126181461 podStartE2EDuration="2.126181461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:24:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:24:19.124715393 +0000 UTC m=+320.691426412" watchObservedRunningTime="2026-06-09 04:24:19.126181461 +0000 UTC m=+320.692892479" Jun 09 04:24:19.568066 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.568024 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5955c99887-6k22m" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" containerID="cri-o://6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5" gracePeriod=15 Jun 09 04:24:19.820379 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.820331 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:24:19.941480 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941450 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941620 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941498 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941620 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941593 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-68x26\" (UniqueName: \"kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941742 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941649 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941798 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941772 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941847 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941837 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert\") pod \"d5453f77-94c5-44a7-b64b-3750a8796a61\" (UID: \"d5453f77-94c5-44a7-b64b-3750a8796a61\") " Jun 09 04:24:19.941900 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941856 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca" (OuterVolumeSpecName: "service-ca") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:19.942098 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.941974 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:19.942256 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.942095 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config" (OuterVolumeSpecName: "console-config") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:19.942256 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.942118 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:19.942256 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.942155 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:19.944180 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.944156 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:19.944246 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.944223 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26" (OuterVolumeSpecName: "kube-api-access-68x26") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "kube-api-access-68x26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:24:19.944305 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:19.944266 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d5453f77-94c5-44a7-b64b-3750a8796a61" (UID: "d5453f77-94c5-44a7-b64b-3750a8796a61"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:20.042748 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.042724 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d5453f77-94c5-44a7-b64b-3750a8796a61-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:20.042748 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.042745 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:20.042869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.042754 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d5453f77-94c5-44a7-b64b-3750a8796a61-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:20.042869 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.042764 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-68x26\" (UniqueName: \"kubernetes.io/projected/d5453f77-94c5-44a7-b64b-3750a8796a61-kube-api-access-68x26\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:20.115175 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.115112 2568 generic.go:356] "Generic (PLEG): container finished" podID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerID="6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5" exitCode=0 Jun 09 04:24:20.115249 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.115172 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5955c99887-6k22m" Jun 09 04:24:20.115292 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.115167 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5955c99887-6k22m" event={"ID":"d5453f77-94c5-44a7-b64b-3750a8796a61","Type":"ContainerDied","Data":"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5"} Jun 09 04:24:20.115292 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.115287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5955c99887-6k22m" event={"ID":"d5453f77-94c5-44a7-b64b-3750a8796a61","Type":"ContainerDied","Data":"0e962a4daff8b88484e880be248da0ab8567dcdfd451d81b06be2168a2ee6f48"} Jun 09 04:24:20.115365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.115307 2568 scope.go:117] "RemoveContainer" containerID="6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5" Jun 09 04:24:20.124340 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.124324 2568 scope.go:117] "RemoveContainer" containerID="6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5" Jun 09 04:24:20.124567 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:20.124549 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5\": container with ID starting with 6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5 not found: ID does not exist" containerID="6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5" Jun 09 04:24:20.124609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.124574 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5"} err="failed to get container status \"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5\": rpc error: code = NotFound desc = could not find container \"6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5\": container with ID starting with 6cd43ce4bd9d6d1ebc014fd7b7b5728e5f977b8c70c0aa7bb0772cf07b04e8e5 not found: ID does not exist" Jun 09 04:24:20.135100 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.135080 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:24:20.139099 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.139078 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5955c99887-6k22m"] Jun 09 04:24:20.875853 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:20.875822 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" path="/var/lib/kubelet/pods/d5453f77-94c5-44a7-b64b-3750a8796a61/volumes" Jun 09 04:24:28.044740 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:28.044697 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:28.045183 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:28.044762 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:28.049942 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:28.049910 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:28.163180 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:28.163155 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:24:28.204937 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:28.204911 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:24:53.231422 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.231319 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bb6c6f55d-88llq" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" containerID="cri-o://ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37" gracePeriod=15 Jun 09 04:24:53.484573 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.484519 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:24:53.610630 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610588 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.610799 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610653 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.610799 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610681 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.610799 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610696 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.610799 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w92mr\" (UniqueName: \"kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.611015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610801 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.611015 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.610825 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle\") pod \"fc87567c-7c79-4544-bf9c-56c803b86e09\" (UID: \"fc87567c-7c79-4544-bf9c-56c803b86e09\") " Jun 09 04:24:53.611117 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.611054 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:53.611284 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.611248 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config" (OuterVolumeSpecName: "console-config") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:53.611403 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.611333 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:53.611403 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.611354 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:24:53.612963 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.612932 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr" (OuterVolumeSpecName: "kube-api-access-w92mr") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "kube-api-access-w92mr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:24:53.613066 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.612982 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:53.613066 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.613011 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc87567c-7c79-4544-bf9c-56c803b86e09" (UID: "fc87567c-7c79-4544-bf9c-56c803b86e09"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:24:53.711414 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711385 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711414 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711408 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711414 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711418 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711592 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711426 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w92mr\" (UniqueName: \"kubernetes.io/projected/fc87567c-7c79-4544-bf9c-56c803b86e09-kube-api-access-w92mr\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711592 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711435 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc87567c-7c79-4544-bf9c-56c803b86e09-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711592 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711442 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:53.711592 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:53.711450 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc87567c-7c79-4544-bf9c-56c803b86e09-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:24:54.278767 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.278732 2568 generic.go:356] "Generic (PLEG): container finished" podID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerID="ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37" exitCode=0 Jun 09 04:24:54.278767 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.278767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c6f55d-88llq" event={"ID":"fc87567c-7c79-4544-bf9c-56c803b86e09","Type":"ContainerDied","Data":"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37"} Jun 09 04:24:54.279233 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.278785 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bb6c6f55d-88llq" Jun 09 04:24:54.279233 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.278799 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bb6c6f55d-88llq" event={"ID":"fc87567c-7c79-4544-bf9c-56c803b86e09","Type":"ContainerDied","Data":"17b9ae33c4356291e662fc418806e0aa420a1a8e8284e45ad936be4f73a61729"} Jun 09 04:24:54.279233 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.278817 2568 scope.go:117] "RemoveContainer" containerID="ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37" Jun 09 04:24:54.288068 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.288052 2568 scope.go:117] "RemoveContainer" containerID="ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37" Jun 09 04:24:54.288338 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:24:54.288321 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37\": container with ID starting with ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37 not found: ID does not exist" containerID="ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37" Jun 09 04:24:54.288414 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.288345 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37"} err="failed to get container status \"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37\": rpc error: code = NotFound desc = could not find container \"ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37\": container with ID starting with ffb19b01f70a79b6280d4d8bea42ee924f212aac29c3497f05e7a7f762867c37 not found: ID does not exist" Jun 09 04:24:54.298787 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.298764 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:24:54.302348 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.302327 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bb6c6f55d-88llq"] Jun 09 04:24:54.875013 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:24:54.874972 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" path="/var/lib/kubelet/pods/fc87567c-7c79-4544-bf9c-56c803b86e09/volumes" Jun 09 04:26:05.839794 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.839757 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840122 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840154 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840172 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840177 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840238 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc87567c-7c79-4544-bf9c-56c803b86e09" containerName="console" Jun 09 04:26:05.840351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.840251 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5453f77-94c5-44a7-b64b-3750a8796a61" containerName="console" Jun 09 04:26:05.842328 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.842308 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.852045 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.852024 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:26:05.961948 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.961922 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kl6x\" (UniqueName: \"kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962069 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.961966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962069 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.962029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962069 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.962063 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962213 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.962103 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962213 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.962172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:05.962213 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:05.962208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063337 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063299 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063337 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063344 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063430 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063682 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063614 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kl6x\" (UniqueName: \"kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.063732 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.063683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.064670 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.064640 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.064857 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.064692 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.064993 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.064968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.071284 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.064850 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.071721 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.071695 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.071818 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.071719 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.073737 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.073714 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kl6x\" (UniqueName: \"kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x\") pod \"console-7658f6549f-qqwfr\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.153636 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.153608 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:06.284412 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.284376 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:26:06.287816 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:26:06.287789 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf355e0bd_152b_4672_bb20_0600829ae4fc.slice/crio-cde01f3fac2ab0bfac6767bb04e4427e09fbbd312712c9767f1cf01f3ac20d6f WatchSource:0}: Error finding container cde01f3fac2ab0bfac6767bb04e4427e09fbbd312712c9767f1cf01f3ac20d6f: Status 404 returned error can't find the container with id cde01f3fac2ab0bfac6767bb04e4427e09fbbd312712c9767f1cf01f3ac20d6f Jun 09 04:26:06.586012 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.585925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7658f6549f-qqwfr" event={"ID":"f355e0bd-152b-4672-bb20-0600829ae4fc","Type":"ContainerStarted","Data":"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2"} Jun 09 04:26:06.586012 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.585973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7658f6549f-qqwfr" event={"ID":"f355e0bd-152b-4672-bb20-0600829ae4fc","Type":"ContainerStarted","Data":"cde01f3fac2ab0bfac6767bb04e4427e09fbbd312712c9767f1cf01f3ac20d6f"} Jun 09 04:26:06.602547 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:06.602482 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7658f6549f-qqwfr" podStartSLOduration=1.602461716 podStartE2EDuration="1.602461716s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:26:06.601330588 +0000 UTC m=+428.168041599" watchObservedRunningTime="2026-06-09 04:26:06.602461716 +0000 UTC m=+428.169172735" Jun 09 04:26:16.154704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:16.154667 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:16.155194 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:16.154725 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:16.159390 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:16.159371 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:16.634641 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:16.634557 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:26:16.677462 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:16.677427 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:26:41.701810 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:41.701735 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-65cc444486-wl5zs" podUID="b74fa311-7034-41ae-8f11-81bf600b641c" containerName="console" containerID="cri-o://547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd" gracePeriod=15 Jun 09 04:26:41.945290 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:41.945266 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:26:42.036771 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.036713 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.036771 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.036753 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.036924 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.036790 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.036924 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.036828 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.036924 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.036870 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.037055 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037033 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.037126 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037107 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsmpt\" (UniqueName: \"kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt\") pod \"b74fa311-7034-41ae-8f11-81bf600b641c\" (UID: \"b74fa311-7034-41ae-8f11-81bf600b641c\") " Jun 09 04:26:42.037225 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037198 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca" (OuterVolumeSpecName: "service-ca") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:26:42.037289 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037220 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:26:42.037289 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037245 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:26:42.037504 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037479 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.037600 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037507 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.037600 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037526 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.037600 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.037522 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config" (OuterVolumeSpecName: "console-config") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:26:42.038975 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.038955 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:26:42.039104 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.039089 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:26:42.039466 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.039447 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt" (OuterVolumeSpecName: "kube-api-access-tsmpt") pod "b74fa311-7034-41ae-8f11-81bf600b641c" (UID: "b74fa311-7034-41ae-8f11-81bf600b641c"). InnerVolumeSpecName "kube-api-access-tsmpt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:26:42.138063 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.138036 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.138063 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.138057 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b74fa311-7034-41ae-8f11-81bf600b641c-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.138063 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.138066 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsmpt\" (UniqueName: \"kubernetes.io/projected/b74fa311-7034-41ae-8f11-81bf600b641c-kube-api-access-tsmpt\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.138250 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.138076 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b74fa311-7034-41ae-8f11-81bf600b641c-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:26:42.755907 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.755875 2568 generic.go:356] "Generic (PLEG): container finished" podID="b74fa311-7034-41ae-8f11-81bf600b641c" containerID="547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd" exitCode=0 Jun 09 04:26:42.756374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.755928 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65cc444486-wl5zs" Jun 09 04:26:42.756374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.755973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc444486-wl5zs" event={"ID":"b74fa311-7034-41ae-8f11-81bf600b641c","Type":"ContainerDied","Data":"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd"} Jun 09 04:26:42.756374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.756050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65cc444486-wl5zs" event={"ID":"b74fa311-7034-41ae-8f11-81bf600b641c","Type":"ContainerDied","Data":"4d642543770892016c9fc949ef688cc55280d06b4f08ad3bb709a9b23af49de3"} Jun 09 04:26:42.756374 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.756084 2568 scope.go:117] "RemoveContainer" containerID="547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd" Jun 09 04:26:42.766276 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.766246 2568 scope.go:117] "RemoveContainer" containerID="547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd" Jun 09 04:26:42.766600 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:26:42.766573 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd\": container with ID starting with 547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd not found: ID does not exist" containerID="547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd" Jun 09 04:26:42.766704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.766607 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd"} err="failed to get container status \"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd\": rpc error: code = NotFound desc = could not find container \"547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd\": container with ID starting with 547b3d627bf0a46257f622ea2732774f1aa2b8eae50a21ada976ff7429ca19cd not found: ID does not exist" Jun 09 04:26:42.776887 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.776861 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:26:42.782703 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.782675 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65cc444486-wl5zs"] Jun 09 04:26:42.876056 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:26:42.876032 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b74fa311-7034-41ae-8f11-81bf600b641c" path="/var/lib/kubelet/pods/b74fa311-7034-41ae-8f11-81bf600b641c/volumes" Jun 09 04:27:04.570863 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.570826 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j"] Jun 09 04:27:04.571435 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.571314 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b74fa311-7034-41ae-8f11-81bf600b641c" containerName="console" Jun 09 04:27:04.571435 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.571334 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b74fa311-7034-41ae-8f11-81bf600b641c" containerName="console" Jun 09 04:27:04.571558 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.571441 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b74fa311-7034-41ae-8f11-81bf600b641c" containerName="console" Jun 09 04:27:04.575549 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.575530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.577786 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.577769 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 04:27:04.577881 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.577766 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 04:27:04.578491 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.578477 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4xxpm\"" Jun 09 04:27:04.582704 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.582674 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j"] Jun 09 04:27:04.711537 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.711493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sp56g\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-kube-api-access-sp56g\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.711706 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.711547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.812180 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.812124 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.812351 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.812254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sp56g\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-kube-api-access-sp56g\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.819796 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.819760 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sp56g\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-kube-api-access-sp56g\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.819916 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.819798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4728c746-00cb-416d-9e40-f73b611bf546-bound-sa-token\") pod \"cert-manager-cainjector-5d99449ffd-x9h2j\" (UID: \"4728c746-00cb-416d-9e40-f73b611bf546\") " pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:04.896539 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:04.896461 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" Jun 09 04:27:05.033324 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:05.033291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j"] Jun 09 04:27:05.036269 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:27:05.036240 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4728c746_00cb_416d_9e40_f73b611bf546.slice/crio-b71f4d05a6e1ec74c8d4a445e50658cfbe0ea719c7872dcbc750d9ec54b0437f WatchSource:0}: Error finding container b71f4d05a6e1ec74c8d4a445e50658cfbe0ea719c7872dcbc750d9ec54b0437f: Status 404 returned error can't find the container with id b71f4d05a6e1ec74c8d4a445e50658cfbe0ea719c7872dcbc750d9ec54b0437f Jun 09 04:27:05.864262 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:05.864226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" event={"ID":"4728c746-00cb-416d-9e40-f73b611bf546","Type":"ContainerStarted","Data":"b71f4d05a6e1ec74c8d4a445e50658cfbe0ea719c7872dcbc750d9ec54b0437f"} Jun 09 04:27:08.879707 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:08.879670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" event={"ID":"4728c746-00cb-416d-9e40-f73b611bf546","Type":"ContainerStarted","Data":"0baa09536f4a71fb151d361eeec15cbbd9d3d5316d5df3e5c8a5320e7c9f126e"} Jun 09 04:27:08.896583 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:08.896534 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5d99449ffd-x9h2j" podStartSLOduration=1.9447855010000001 podStartE2EDuration="4.896518259s" totalImagesPullingTime="2.951732758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:27:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:27:08.895078487 +0000 UTC m=+490.461789506" watchObservedRunningTime="2026-06-09 04:27:08.896518259 +0000 UTC m=+490.463229278" Jun 09 04:27:21.617080 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.617043 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-59c77684cc-pf6rp"] Jun 09 04:27:21.620303 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.620286 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.622444 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.622426 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-fchz9\"" Jun 09 04:27:21.627915 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.627885 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pf6rp"] Jun 09 04:27:21.767365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.767324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw67d\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-kube-api-access-kw67d\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.767365 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.767369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-bound-sa-token\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.868656 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.868595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw67d\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-kube-api-access-kw67d\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.868656 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.868629 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-bound-sa-token\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.875921 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.875892 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-bound-sa-token\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.876059 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.876040 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw67d\" (UniqueName: \"kubernetes.io/projected/e814460e-f8ee-418f-9d62-31aa6fdce3b2-kube-api-access-kw67d\") pod \"cert-manager-59c77684cc-pf6rp\" (UID: \"e814460e-f8ee-418f-9d62-31aa6fdce3b2\") " pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:21.930527 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:21.930492 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-59c77684cc-pf6rp" Jun 09 04:27:22.057742 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:22.057714 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-59c77684cc-pf6rp"] Jun 09 04:27:22.060794 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:27:22.060763 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode814460e_f8ee_418f_9d62_31aa6fdce3b2.slice/crio-cc51da7d41aac078d39325d64d3d35ac0a4e2b9a964c953fd9266d3604efce91 WatchSource:0}: Error finding container cc51da7d41aac078d39325d64d3d35ac0a4e2b9a964c953fd9266d3604efce91: Status 404 returned error can't find the container with id cc51da7d41aac078d39325d64d3d35ac0a4e2b9a964c953fd9266d3604efce91 Jun 09 04:27:22.949142 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:22.949108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pf6rp" event={"ID":"e814460e-f8ee-418f-9d62-31aa6fdce3b2","Type":"ContainerStarted","Data":"4d23b84f123761e1a061fa7c80950f7ec0fe96871aa0e21746292d44cd2b836a"} Jun 09 04:27:22.949486 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:22.949169 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-59c77684cc-pf6rp" event={"ID":"e814460e-f8ee-418f-9d62-31aa6fdce3b2","Type":"ContainerStarted","Data":"cc51da7d41aac078d39325d64d3d35ac0a4e2b9a964c953fd9266d3604efce91"} Jun 09 04:27:22.964816 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:27:22.964769 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-59c77684cc-pf6rp" podStartSLOduration=1.96475515 podStartE2EDuration="1.96475515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:27:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:27:22.962693848 +0000 UTC m=+504.529404878" watchObservedRunningTime="2026-06-09 04:27:22.96475515 +0000 UTC m=+504.531466169" Jun 09 04:28:11.517732 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.517655 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq"] Jun 09 04:28:11.520085 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.520068 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.522369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.522345 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kubeflow-trainer-config\"" Jun 09 04:28:11.522503 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.522345 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-webhook-cert\"" Jun 09 04:28:11.523232 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.523214 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 04:28:11.523331 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.523233 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kubeflow-trainer-controller-manager-dockercfg-wgg6r\"" Jun 09 04:28:11.523331 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.523218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 04:28:11.529798 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.529779 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq"] Jun 09 04:28:11.679314 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.679280 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.679474 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.679330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.679474 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.679420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58m8r\" (UniqueName: \"kubernetes.io/projected/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kube-api-access-58m8r\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.780504 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.780434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.780504 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.780474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.780665 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.780523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58m8r\" (UniqueName: \"kubernetes.io/projected/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kube-api-access-58m8r\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.781105 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.781073 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubeflow-trainer-config\" (UniqueName: \"kubernetes.io/configmap/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kubeflow-trainer-config\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.782904 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.782884 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-cert\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.792469 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.792443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58m8r\" (UniqueName: \"kubernetes.io/projected/7d4d5021-8c27-4fc5-ac08-8029ab37f2af-kube-api-access-58m8r\") pod \"kubeflow-trainer-controller-manager-857f77d56c-bqjdq\" (UID: \"7d4d5021-8c27-4fc5-ac08-8029ab37f2af\") " pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.829410 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.829387 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:11.957232 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:11.957206 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq"] Jun 09 04:28:11.959165 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:28:11.959118 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7d4d5021_8c27_4fc5_ac08_8029ab37f2af.slice/crio-b62241c22b4f3f1bcc30529affb47209bfe385fabb97311a4753a1d1f28d06ab WatchSource:0}: Error finding container b62241c22b4f3f1bcc30529affb47209bfe385fabb97311a4753a1d1f28d06ab: Status 404 returned error can't find the container with id b62241c22b4f3f1bcc30529affb47209bfe385fabb97311a4753a1d1f28d06ab Jun 09 04:28:12.168665 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:12.168639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" event={"ID":"7d4d5021-8c27-4fc5-ac08-8029ab37f2af","Type":"ContainerStarted","Data":"b62241c22b4f3f1bcc30529affb47209bfe385fabb97311a4753a1d1f28d06ab"} Jun 09 04:28:15.186291 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:15.186257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" event={"ID":"7d4d5021-8c27-4fc5-ac08-8029ab37f2af","Type":"ContainerStarted","Data":"cda556c925351bf3d378131f5628043da5cd029afb766a99e85b0991f9a0e40b"} Jun 09 04:28:15.186656 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:15.186312 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:15.200690 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:15.200650 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" podStartSLOduration=1.468347377 podStartE2EDuration="4.200636428s" totalImagesPullingTime="2.732289051s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:28:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:28:15.199310002 +0000 UTC m=+556.766021022" watchObservedRunningTime="2026-06-09 04:28:15.200636428 +0000 UTC m=+556.767347487" Jun 09 04:28:31.195983 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:31.195951 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kubeflow-trainer-controller-manager-857f77d56c-bqjdq" Jun 09 04:28:58.851355 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:58.851325 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:28:58.851922 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:58.851453 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:28:58.858907 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:58.858889 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:28:58.859039 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:28:58.858944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:29:36.090013 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.089939 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-585967887d-8th8m"] Jun 09 04:29:36.093464 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.093438 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.104760 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.104735 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585967887d-8th8m"] Jun 09 04:29:36.136216 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-oauth-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136325 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136325 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136408 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136328 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-trusted-ca-bundle\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136408 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-oauth-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136478 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136417 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbb77\" (UniqueName: \"kubernetes.io/projected/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-kube-api-access-dbb77\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.136478 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.136440 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-service-ca\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237409 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-oauth-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237411 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-trusted-ca-bundle\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237520 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-oauth-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237708 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbb77\" (UniqueName: \"kubernetes.io/projected/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-kube-api-access-dbb77\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.237708 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.237576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-service-ca\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.238249 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.238227 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.238362 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.238337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-oauth-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.238438 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.238422 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-trusted-ca-bundle\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.238552 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.238523 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-service-ca\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.239890 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.239872 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-serving-cert\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.239986 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.239968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-console-oauth-config\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.244794 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.244764 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbb77\" (UniqueName: \"kubernetes.io/projected/3a701a0b-bf3a-4fa0-83e0-5f376c6975be-kube-api-access-dbb77\") pod \"console-585967887d-8th8m\" (UID: \"3a701a0b-bf3a-4fa0-83e0-5f376c6975be\") " pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.403381 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.403359 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:36.538099 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.538073 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-585967887d-8th8m"] Jun 09 04:29:36.540293 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:29:36.540265 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a701a0b_bf3a_4fa0_83e0_5f376c6975be.slice/crio-c54e260893b3ea0b944b1261e879135b6b2f14c7bedac0482c577a742c961c74 WatchSource:0}: Error finding container c54e260893b3ea0b944b1261e879135b6b2f14c7bedac0482c577a742c961c74: Status 404 returned error can't find the container with id c54e260893b3ea0b944b1261e879135b6b2f14c7bedac0482c577a742c961c74 Jun 09 04:29:36.559887 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:36.559843 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585967887d-8th8m" event={"ID":"3a701a0b-bf3a-4fa0-83e0-5f376c6975be","Type":"ContainerStarted","Data":"c54e260893b3ea0b944b1261e879135b6b2f14c7bedac0482c577a742c961c74"} Jun 09 04:29:37.566082 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:37.566043 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-585967887d-8th8m" event={"ID":"3a701a0b-bf3a-4fa0-83e0-5f376c6975be","Type":"ContainerStarted","Data":"21ccff9a308ed1bce69577a1b9ec92ccc0ea43e35c31f345557e92922aff6753"} Jun 09 04:29:37.584734 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:37.584681 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-585967887d-8th8m" podStartSLOduration=1.584665303 podStartE2EDuration="1.584665303s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:29:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:29:37.582674841 +0000 UTC m=+639.149385861" watchObservedRunningTime="2026-06-09 04:29:37.584665303 +0000 UTC m=+639.151376321" Jun 09 04:29:46.403489 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:46.403451 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:46.403949 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:46.403567 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:46.408318 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:46.408299 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:46.610371 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:46.610342 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-585967887d-8th8m" Jun 09 04:29:46.657954 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:29:46.657883 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:30:11.679656 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:11.679579 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7658f6549f-qqwfr" podUID="f355e0bd-152b-4672-bb20-0600829ae4fc" containerName="console" containerID="cri-o://32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2" gracePeriod=15 Jun 09 04:30:11.929880 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:11.929824 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:30:12.032279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032245 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kl6x\" (UniqueName: \"kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032279 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032282 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032499 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032313 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032499 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032341 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032499 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032416 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032499 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032465 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032703 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032507 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle\") pod \"f355e0bd-152b-4672-bb20-0600829ae4fc\" (UID: \"f355e0bd-152b-4672-bb20-0600829ae4fc\") " Jun 09 04:30:12.032780 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032754 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:30:12.032920 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032880 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca" (OuterVolumeSpecName: "service-ca") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:30:12.032920 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.032882 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config" (OuterVolumeSpecName: "console-config") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:30:12.033301 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.033265 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 04:30:12.034548 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.034518 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x" (OuterVolumeSpecName: "kube-api-access-9kl6x") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "kube-api-access-9kl6x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 04:30:12.034778 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.034755 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:30:12.034861 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.034776 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f355e0bd-152b-4672-bb20-0600829ae4fc" (UID: "f355e0bd-152b-4672-bb20-0600829ae4fc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 04:30:12.134115 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134086 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-oauth-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134115 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134112 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-serving-cert\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134115 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134122 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-service-ca\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134378 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134148 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f355e0bd-152b-4672-bb20-0600829ae4fc-console-oauth-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134378 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134157 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-console-config\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134378 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134165 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f355e0bd-152b-4672-bb20-0600829ae4fc-trusted-ca-bundle\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.134378 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.134173 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kl6x\" (UniqueName: \"kubernetes.io/projected/f355e0bd-152b-4672-bb20-0600829ae4fc-kube-api-access-9kl6x\") on node \"ip-10-0-135-201.ec2.internal\" DevicePath \"\"" Jun 09 04:30:12.726795 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.726759 2568 generic.go:356] "Generic (PLEG): container finished" podID="f355e0bd-152b-4672-bb20-0600829ae4fc" containerID="32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2" exitCode=0 Jun 09 04:30:12.727253 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.726817 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7658f6549f-qqwfr" Jun 09 04:30:12.727253 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.726863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7658f6549f-qqwfr" event={"ID":"f355e0bd-152b-4672-bb20-0600829ae4fc","Type":"ContainerDied","Data":"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2"} Jun 09 04:30:12.727253 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.726931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7658f6549f-qqwfr" event={"ID":"f355e0bd-152b-4672-bb20-0600829ae4fc","Type":"ContainerDied","Data":"cde01f3fac2ab0bfac6767bb04e4427e09fbbd312712c9767f1cf01f3ac20d6f"} Jun 09 04:30:12.727253 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.726953 2568 scope.go:117] "RemoveContainer" containerID="32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2" Jun 09 04:30:12.737226 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.737207 2568 scope.go:117] "RemoveContainer" containerID="32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2" Jun 09 04:30:12.737613 ip-10-0-135-201 kubenswrapper[2568]: E0609 04:30:12.737586 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2\": container with ID starting with 32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2 not found: ID does not exist" containerID="32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2" Jun 09 04:30:12.737664 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.737624 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2"} err="failed to get container status \"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2\": rpc error: code = NotFound desc = could not find container \"32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2\": container with ID starting with 32d8961c6d0cdbce1c33128a5181bd6fa195942459e770c9e04cd9adc16d8fb2 not found: ID does not exist" Jun 09 04:30:12.747654 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.747628 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:30:12.752233 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.752209 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7658f6549f-qqwfr"] Jun 09 04:30:12.876101 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:12.876077 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f355e0bd-152b-4672-bb20-0600829ae4fc" path="/var/lib/kubelet/pods/f355e0bd-152b-4672-bb20-0600829ae4fc/volumes" Jun 09 04:30:22.182199 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:22.182165 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-bqjdq_7d4d5021-8c27-4fc5-ac08-8029ab37f2af/manager/0.log" Jun 09 04:30:22.626369 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:22.626290 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-bqjdq_7d4d5021-8c27-4fc5-ac08-8029ab37f2af/manager/0.log" Jun 09 04:30:23.060398 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:23.060370 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kubeflow-trainer-controller-manager-857f77d56c-bqjdq_7d4d5021-8c27-4fc5-ac08-8029ab37f2af/manager/0.log" Jun 09 04:30:58.379347 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.379310 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwhmf/must-gather-lhwk6"] Jun 09 04:30:58.379767 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.379625 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f355e0bd-152b-4672-bb20-0600829ae4fc" containerName="console" Jun 09 04:30:58.379767 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.379635 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f355e0bd-152b-4672-bb20-0600829ae4fc" containerName="console" Jun 09 04:30:58.379767 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.379709 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f355e0bd-152b-4672-bb20-0600829ae4fc" containerName="console" Jun 09 04:30:58.382755 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.382739 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.384821 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.384803 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwhmf\"/\"kube-root-ca.crt\"" Jun 09 04:30:58.385487 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.385474 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwhmf\"/\"openshift-service-ca.crt\"" Jun 09 04:30:58.385545 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.385501 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwhmf\"/\"default-dockercfg-6h47m\"" Jun 09 04:30:58.388308 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.388283 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwhmf/must-gather-lhwk6"] Jun 09 04:30:58.508234 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.508208 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqk6v\" (UniqueName: \"kubernetes.io/projected/f9f09026-f884-46f4-99fe-3813b5e79673-kube-api-access-bqk6v\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.508340 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.508249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9f09026-f884-46f4-99fe-3813b5e79673-must-gather-output\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.609536 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.609514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqk6v\" (UniqueName: \"kubernetes.io/projected/f9f09026-f884-46f4-99fe-3813b5e79673-kube-api-access-bqk6v\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.609658 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.609552 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9f09026-f884-46f4-99fe-3813b5e79673-must-gather-output\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.609840 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.609824 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f9f09026-f884-46f4-99fe-3813b5e79673-must-gather-output\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.616996 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.616979 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqk6v\" (UniqueName: \"kubernetes.io/projected/f9f09026-f884-46f4-99fe-3813b5e79673-kube-api-access-bqk6v\") pod \"must-gather-lhwk6\" (UID: \"f9f09026-f884-46f4-99fe-3813b5e79673\") " pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.692865 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.692842 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" Jun 09 04:30:58.825963 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.825938 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwhmf/must-gather-lhwk6"] Jun 09 04:30:58.828380 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:30:58.828354 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9f09026_f884_46f4_99fe_3813b5e79673.slice/crio-3db7d0b0ef00c786af170df4650234f2212a4f2ac62559bdacc44c54573c0ee1 WatchSource:0}: Error finding container 3db7d0b0ef00c786af170df4650234f2212a4f2ac62559bdacc44c54573c0ee1: Status 404 returned error can't find the container with id 3db7d0b0ef00c786af170df4650234f2212a4f2ac62559bdacc44c54573c0ee1 Jun 09 04:30:58.830324 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.830308 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 04:30:58.940996 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:58.940970 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" event={"ID":"f9f09026-f884-46f4-99fe-3813b5e79673","Type":"ContainerStarted","Data":"3db7d0b0ef00c786af170df4650234f2212a4f2ac62559bdacc44c54573c0ee1"} Jun 09 04:30:59.949092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:59.949013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" event={"ID":"f9f09026-f884-46f4-99fe-3813b5e79673","Type":"ContainerStarted","Data":"0af25f7cfb75fb429afb793bf9e39fab474a94ac789e3330d417f9e1bdbb8ea8"} Jun 09 04:30:59.949092 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:59.949052 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" event={"ID":"f9f09026-f884-46f4-99fe-3813b5e79673","Type":"ContainerStarted","Data":"34b3497bce126c22b0d5617cfb8e224723f19729acd6f8d5ff4568a6a95400ed"} Jun 09 04:30:59.962450 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:30:59.962398 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mwhmf/must-gather-lhwk6" podStartSLOduration=1.134301386 podStartE2EDuration="1.962375802s" totalImagesPullingTime="828.074416ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 04:30:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:30:59.960990761 +0000 UTC m=+721.527701793" watchObservedRunningTime="2026-06-09 04:30:59.962375802 +0000 UTC m=+721.529086822" Jun 09 04:31:00.975864 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:00.975833 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bpb6w_11da152c-7e1f-41a8-9545-e661f523b5ce/global-pull-secret-syncer/0.log" Jun 09 04:31:01.094893 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:01.094861 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mnh49_9661392c-e0aa-48fa-8bc2-906c1ac58200/konnectivity-agent/0.log" Jun 09 04:31:01.131950 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:01.131919 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-201.ec2.internal_cafe6f486dffca6906cacfbb14ec640b/haproxy/0.log" Jun 09 04:31:04.677631 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.677594 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/alertmanager/0.log" Jun 09 04:31:04.713174 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.713118 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/config-reloader/0.log" Jun 09 04:31:04.750394 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.750362 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/kube-rbac-proxy-web/0.log" Jun 09 04:31:04.777417 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.777385 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/kube-rbac-proxy/0.log" Jun 09 04:31:04.806743 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.806706 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/kube-rbac-proxy-metric/0.log" Jun 09 04:31:04.831598 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.831562 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/prom-label-proxy/0.log" Jun 09 04:31:04.855384 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.855350 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_21b50d76-b534-4ea6-bfb6-bd79817c2d5a/init-config-reloader/0.log" Jun 09 04:31:04.893882 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.893845 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-l9s7m_5b9812a5-a3b2-4470-8b91-77d203674024/cluster-monitoring-operator/0.log" Jun 09 04:31:04.922278 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.922241 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-state-metrics/0.log" Jun 09 04:31:04.942609 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.942528 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-rbac-proxy-main/0.log" Jun 09 04:31:04.963964 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.963939 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-pfrfq_05543f3d-e4e3-42a1-9558-ec4f2afb84b6/kube-rbac-proxy-self/0.log" Jun 09 04:31:04.992992 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:04.992962 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-56f6cff5-bf9dv_3244d450-973c-430a-b08e-2383117ba326/metrics-server/0.log" Jun 09 04:31:05.020284 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.020251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-vsbh4_698ed63b-3172-41c6-8a01-cc32363a5fff/monitoring-plugin/0.log" Jun 09 04:31:05.196559 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.196479 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/node-exporter/0.log" Jun 09 04:31:05.221348 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.221296 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/kube-rbac-proxy/0.log" Jun 09 04:31:05.247284 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.247249 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xbqlf_509e8e8d-f97b-4cac-8d0b-dc85c78cc878/init-textfile/0.log" Jun 09 04:31:05.273909 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.273877 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/kube-rbac-proxy-main/0.log" Jun 09 04:31:05.296028 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.295995 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/kube-rbac-proxy-self/0.log" Jun 09 04:31:05.318031 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.317999 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-2zjhc_4c3587e4-a970-48fe-a01d-9d4b6ad1cd16/openshift-state-metrics/0.log" Jun 09 04:31:05.544550 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.544468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-5bnrz_10d6b572-ef7d-48f4-9725-5d958b6fda00/prometheus-operator-admission-webhook/0.log" Jun 09 04:31:05.583516 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.583460 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6475cf8b68-cqzlj_bf7f236b-46fd-41da-b6f0-7fd4449b3906/telemeter-client/0.log" Jun 09 04:31:05.609094 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.609061 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6475cf8b68-cqzlj_bf7f236b-46fd-41da-b6f0-7fd4449b3906/reload/0.log" Jun 09 04:31:05.633167 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:05.633119 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6475cf8b68-cqzlj_bf7f236b-46fd-41da-b6f0-7fd4449b3906/kube-rbac-proxy/0.log" Jun 09 04:31:07.040762 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:07.040726 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-z6nxz_e0fd2cb3-e113-425c-9369-43eae8cb6945/networking-console-plugin/0.log" Jun 09 04:31:07.570243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:07.570217 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/2.log" Jun 09 04:31:07.579193 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:07.579168 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-rqvvw_c1430094-dc0b-4b18-9e35-6a0e1cbcdd94/console-operator/3.log" Jun 09 04:31:07.982069 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:07.982040 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-585967887d-8th8m_3a701a0b-bf3a-4fa0-83e0-5f376c6975be/console/0.log" Jun 09 04:31:08.011159 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:08.011106 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-8cggg_5f4e562f-6d0a-4674-be92-c35b5cdc16eb/download-server/0.log" Jun 09 04:31:08.500970 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:08.500940 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-gb9gd_9cca3c15-fe39-4cbc-8686-ae9117979a3c/volume-data-source-validator/0.log" Jun 09 04:31:09.090849 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.090812 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b"] Jun 09 04:31:09.097062 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.097030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.101881 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.101852 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b"] Jun 09 04:31:09.217108 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.217064 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-lib-modules\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.217312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.217157 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8fmz\" (UniqueName: \"kubernetes.io/projected/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-kube-api-access-t8fmz\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.217312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.217218 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-sys\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.217312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.217251 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-podres\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.217312 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.217291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-proc\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.317802 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8fmz\" (UniqueName: \"kubernetes.io/projected/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-kube-api-access-t8fmz\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.317960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-sys\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.317960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-sys\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.317960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-podres\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.317960 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-proc\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.318221 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.317980 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-lib-modules\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.318221 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.318053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-proc\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.318221 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.318069 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-podres\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.318221 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.318093 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-lib-modules\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.325076 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.325053 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8fmz\" (UniqueName: \"kubernetes.io/projected/8ed557e3-107c-4f0f-9eef-68b6d266bbb4-kube-api-access-t8fmz\") pod \"perf-node-gather-daemonset-dtc5b\" (UID: \"8ed557e3-107c-4f0f-9eef-68b6d266bbb4\") " pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.413114 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.413080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:09.425781 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.425756 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw8s6_ecddad8a-f092-4b95-9ecc-f67814fc2475/dns/0.log" Jun 09 04:31:09.444297 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.444266 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sw8s6_ecddad8a-f092-4b95-9ecc-f67814fc2475/kube-rbac-proxy/0.log" Jun 09 04:31:09.511840 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.511814 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hp78k_ed958935-96d6-4907-a9e5-34baea7692ca/dns-node-resolver/0.log" Jun 09 04:31:09.561225 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.560532 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b"] Jun 09 04:31:09.563772 ip-10-0-135-201 kubenswrapper[2568]: W0609 04:31:09.563745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8ed557e3_107c_4f0f_9eef_68b6d266bbb4.slice/crio-ed31d0b3f8318c37741eb813668cd6c24aba0edafd40815889397e448cb866d2 WatchSource:0}: Error finding container ed31d0b3f8318c37741eb813668cd6c24aba0edafd40815889397e448cb866d2: Status 404 returned error can't find the container with id ed31d0b3f8318c37741eb813668cd6c24aba0edafd40815889397e448cb866d2 Jun 09 04:31:09.888532 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.888443 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64949f54dc-76hv9_8d1a46c0-a261-4f68-98f3-bda4bc9ec22f/registry/0.log" Jun 09 04:31:09.891835 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.891803 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-64949f54dc-76hv9_8d1a46c0-a261-4f68-98f3-bda4bc9ec22f/registry/1.log" Jun 09 04:31:09.950800 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:09.950761 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rqwmp_73689180-35c0-4259-b343-6a0116039fff/node-ca/0.log" Jun 09 04:31:10.022207 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:10.021279 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" event={"ID":"8ed557e3-107c-4f0f-9eef-68b6d266bbb4","Type":"ContainerStarted","Data":"e70ea7a44672201e9b3ac94d55e2e521ba90ca6821a6062640fed9a576922c7d"} Jun 09 04:31:10.022207 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:10.021343 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" event={"ID":"8ed557e3-107c-4f0f-9eef-68b6d266bbb4","Type":"ContainerStarted","Data":"ed31d0b3f8318c37741eb813668cd6c24aba0edafd40815889397e448cb866d2"} Jun 09 04:31:10.022207 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:10.022144 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:10.037192 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:10.037118 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" podStartSLOduration=1.037101451 podStartE2EDuration="1.037101451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 04:31:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 04:31:10.0353849 +0000 UTC m=+731.602095919" watchObservedRunningTime="2026-06-09 04:31:10.037101451 +0000 UTC m=+731.603812470" Jun 09 04:31:10.954109 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:10.954077 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-smlwz_fc55f224-b07a-47d9-a383-8a910f261251/serve-healthcheck-canary/0.log" Jun 09 04:31:11.399433 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:11.399353 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krns8_57e1e2f7-83bb-4bd1-ab21-aa935dc3a126/kube-rbac-proxy/0.log" Jun 09 04:31:11.419149 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:11.419091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krns8_57e1e2f7-83bb-4bd1-ab21-aa935dc3a126/exporter/0.log" Jun 09 04:31:11.438569 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:11.438530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-krns8_57e1e2f7-83bb-4bd1-ab21-aa935dc3a126/extractor/0.log" Jun 09 04:31:16.257592 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:16.257558 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-r2dw6_134f8ca4-2285-4dbe-910c-56514717c8c6/kube-storage-version-migrator-operator/1.log" Jun 09 04:31:16.258744 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:16.258714 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-r2dw6_134f8ca4-2285-4dbe-910c-56514717c8c6/kube-storage-version-migrator-operator/0.log" Jun 09 04:31:17.042495 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.042470 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwhmf/perf-node-gather-daemonset-dtc5b" Jun 09 04:31:17.313866 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.313798 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/kube-multus-additional-cni-plugins/0.log" Jun 09 04:31:17.332325 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.332302 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/egress-router-binary-copy/0.log" Jun 09 04:31:17.349914 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.349883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/cni-plugins/0.log" Jun 09 04:31:17.368302 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.368284 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/bond-cni-plugin/0.log" Jun 09 04:31:17.386030 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.386009 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/routeoverride-cni/0.log" Jun 09 04:31:17.403471 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.403453 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/whereabouts-cni-bincopy/0.log" Jun 09 04:31:17.420977 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.420957 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-r7cbb_de9a4011-c351-490b-bfc2-4d8310d916a4/whereabouts-cni/0.log" Jun 09 04:31:17.455606 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.455578 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g2rkj_e554b371-885b-45ed-973a-0a62cc7d6bad/kube-multus/0.log" Jun 09 04:31:17.494600 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.494559 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drz8k_f4a913c5-8e81-4375-9119-f94141550ecf/network-metrics-daemon/0.log" Jun 09 04:31:17.509782 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:17.509759 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-drz8k_f4a913c5-8e81-4375-9119-f94141550ecf/kube-rbac-proxy/0.log" Jun 09 04:31:18.240802 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.240773 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-controller/0.log" Jun 09 04:31:18.254957 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.254929 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/0.log" Jun 09 04:31:18.255123 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.254974 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovn-acl-logging/1.log" Jun 09 04:31:18.279108 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.279084 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/kube-rbac-proxy-node/0.log" Jun 09 04:31:18.302178 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.302147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 04:31:18.317563 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.317513 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/northd/0.log" Jun 09 04:31:18.334616 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.334586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/nbdb/0.log" Jun 09 04:31:18.352689 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.352664 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/sbdb/0.log" Jun 09 04:31:18.408506 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:18.408479 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-82vrh_99b1ae0a-1808-4b58-914f-c8d16b928399/ovnkube-controller/0.log" Jun 09 04:31:19.918504 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:19.918472 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-dbd9cf844-9qhnt_edea255f-01cd-4984-94c8-f2b829bfed72/check-endpoints/0.log" Jun 09 04:31:19.944377 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:19.944347 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hb5dm_2a5a38e9-1ebe-4dbb-9e3e-7f828638d2f5/network-check-target-container/0.log" Jun 09 04:31:20.808613 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:20.808586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-29djf_7f999be1-dcf7-47c5-a686-2be18f8e5c6a/iptables-alerter/0.log" Jun 09 04:31:21.475974 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:21.475943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-lshz7_bb89ad4e-cb3c-4fe1-b35f-bbdb97014873/tuned/0.log" Jun 09 04:31:24.357446 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:24.357419 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca_service-ca-7d74d578b8-bq9d8_771bd76f-811b-4470-a82e-703034bdc20d/service-ca-controller/0.log" Jun 09 04:31:24.689243 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:24.689219 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-b6wqg_c6483c48-cbc4-416f-9cf2-2707a7676302/csi-driver/0.log" Jun 09 04:31:24.726891 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:24.726866 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-b6wqg_c6483c48-cbc4-416f-9cf2-2707a7676302/csi-node-driver-registrar/0.log" Jun 09 04:31:24.744202 ip-10-0-135-201 kubenswrapper[2568]: I0609 04:31:24.744182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-b6wqg_c6483c48-cbc4-416f-9cf2-2707a7676302/csi-liveness-probe/0.log"